2021-07-26T15:24:08.511 INFO:root:teuthology version: 1.1.0-b6f3efab 2021-07-26T15:24:08.514 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --owner scheduled_sage@teuthology --description upgrade/octopus-x/rgw-multisite/{clusters frontend overrides realm tasks upgrade/primary} --archive /home/teuthworker/archive/sage-2021-07-26_15:05:01-upgrade-wip-kefu-testing-2021-07-24-1158-distro-basic-smithi/6293836 --name sage-2021-07-26_15:05:01-upgrade-wip-kefu-testing-2021-07-24-1158-distro-basic-smithi -- /home/teuthworker/archive/sage-2021-07-26_15:05:01-upgrade-wip-kefu-testing-2021-07-24-1158-distro-basic-smithi/6293836/orig.config.yaml 2021-07-26T15:24:08.591 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-07-26T15:24:08.647 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/sage-2021-07-26_15:05:01-upgrade-wip-kefu-testing-2021-07-24-1158-distro-basic-smithi/6293836 branch: wip-kefu-testing-2021-07-24-1158 description: upgrade/octopus-x/rgw-multisite/{clusters frontend overrides realm tasks upgrade/primary} email: null first_in_suite: false job_id: '6293836' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: sage-2021-07-26_15:05:01-upgrade-wip-kefu-testing-2021-07-24-1158-distro-basic-smithi nuke-on-error: true overrides: admin_socket: branch: wip-kefu-testing-2021-07-24-1158 ceph: conf: client: debug rgw: 20 rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= rgw curl low speed time: 300 rgw data log num shards: 4 rgw md log max shards: 4 rgw sync log trim interval: 0 rgw sync obj etag verify: true setgroup: ceph setuser: ceph mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon_warn_on_insecure_global_id_reclaim: false mon_warn_on_insecure_global_id_reclaim_allowed: false osd: debug ms: 1 debug osd: 20 log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: bccf07c244ef1754a7e8d345570b6a04f2ee5a7e wait-for-scrub: false ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: branch: octopus sha1: bccf07c244ef1754a7e8d345570b6a04f2ee5a7e rgw: compression type: random frontend: beast rgw-multisite: realm: is default: true name: test-realm zonegroups: - endpoints: - c1.client.0 is_default: true is_master: true name: test-zonegroup zones: - endpoints: - c1.client.0 is_default: true is_master: true name: test-zone1 - endpoints: - c2.client.0 is_default: true name: test-zone2 - endpoints: - c2.client.1 is_pubsub: true name: test-zone3 rgw-multisite-tests: args: - tests.py - tests_ps.py branch: octopus repo: https://github.com/ceph/ceph.git workunit: branch: wip-kefu-testing-2021-07-24-1158 sha1: bccf07c244ef1754a7e8d345570b6a04f2ee5a7e owner: scheduled_sage@teuthology priority: 90 repo: git://git.ceph.com/ceph-ci.git roles: - - c1.mon.a - c1.mgr.x - c1.osd.0 - c1.osd.1 - c1.osd.2 - c1.client.0 - - c2.mon.a - c2.mgr.x - c2.osd.0 - c2.osd.1 - c2.osd.2 - c2.client.0 - c2.client.1 sha1: bccf07c244ef1754a7e8d345570b6a04f2ee5a7e sleep_before_teardown: 0 suite: upgrade suite_branch: wip-kefu-testing-2021-07-24-1158 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_bccf07c244ef1754a7e8d345570b6a04f2ee5a7e/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: bccf07c244ef1754a7e8d345570b6a04f2ee5a7e targets: smithi183.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDD/GJaszGqYDRTECIV+64PPxcOAHJ+vlfdUHu65iDPSknSHUVWVzJH3bjocqSKANXzu7EqxzJi+OZEpIyuJYgBmAfIBQa8kHDDBiRus1zmD90lsolWAeQbxK9gopwWvJ1pa8Dpcd4m1+po67OuSBWcA90gKMkS9J/zbqQcVPQhrV2scHCiB0ezTKAcjfk3xYfMAmjq1jVBdkNa2IFR6opL4A1nfsx4/UBazSiJzqrLr+A21hywmFrJxzuZ4Mh539B3AuxuqBsJqoTrAkMwGiSofYmgf5WxsRhQTwXT2oT+tRFt4anWQ9Q7VHkpIuBA1Us031GiEaGEeBkQgUINsBB26+b8+zxc9Dmg4Z4SUz7AxvTr8liOLfpfv3+PW8yUE27+gQ1AxO5YQS9cBQrSAAlTPTFyrK5OjSHPGNUKNb6MfFCbm/8XpRddA1Ou8OfOFTloBCscnMVZ6wI4ME6wjG/Y/YbzN69JMMKmtQZUNE+hfE7oxRMd13a4LxoL7dK3d10= smithi197.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDGMPwfQjgrFUV1MRh9ksGbxFWOU2Zlm6eRIroOSl506mwAY74uYgvVew8jXHh1JtsBBRj/TepKgy65HLgqT3unQ3vXXXbRCtRhiTQeBhc3w5t+YbD1y+rpvFpc7RoFh6F92/s7Wstt7D9QlSLu10QTw6MWTcK46BG1e5jJYWLf2PM/HAJtKiJB3sKsQKaXSwYTKhwXVESW76uXf/SwAs3Qe2+uYCjIYrQqTJXDHu53IpuAcCkwJKNkhSbPMWQgH77L5fnvflWL50BkVEFpwgCWkFH464fl1N2v/l+aFkTkzDmX/Z9fDSK2JduuUmAXpkEMh40J4pFbLgP7qao/VJTkMA/JeWDN6D96G230WjRemPdd4M+Puz/WJUUQjRY/4Uojd70AI+n+zTXNEqr8DGuNbZPk/1+DIW22udhqYSFw8GWpyVN4IAbJWxlBCGi246P2+0/DymNFlBY7AzobipHkS81+Qn/ZnHG2en7GKWrov8jc4kf8HUCrJSAptXLUBkU= tasks: - install: null - ceph: cluster: c1 - ceph: cluster: c2 - parallel: - upgrade-task - rgw: c1.client.0: port: 8000 c2.client.0: port: 8000 c2.client.1: port: 8001 - rgw-multisite: null - rgw-multisite-tests: config: reconfigure_delay: 60 teuthology_branch: master teuthology_sha1: b6f3efab84b70e18e86ec271a07564aeb4ed3bac timestamp: 2021-07-26_15:05:01 tube: smithi upgrade-task: - install.upgrade: c1.client.0: null c1.mgr.x: null c1.mon.a: null c1.osd.0: null c1.osd.1: null c1.osd.2: null user: sage verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.30581 2021-07-26T15:24:08.648 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_bccf07c244ef1754a7e8d345570b6a04f2ee5a7e/qa; will attempt to use it 2021-07-26T15:24:08.649 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_bccf07c244ef1754a7e8d345570b6a04f2ee5a7e/qa/tasks 2021-07-26T15:24:08.649 INFO:teuthology.run_tasks:Running task internal.check_packages... 2021-07-26T15:24:08.651 INFO:teuthology.task.internal:Checking packages... 2021-07-26T15:24:08.652 INFO:teuthology.task.internal:Checking packages skipped, missing os_type 'None' or ceph hash 'bccf07c244ef1754a7e8d345570b6a04f2ee5a7e' 2021-07-26T15:24:08.652 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2021-07-26T15:24:08.667 INFO:teuthology.task.internal:no buildpackages task found 2021-07-26T15:24:08.668 INFO:teuthology.run_tasks:Running task internal.save_config... 2021-07-26T15:24:08.693 INFO:teuthology.task.internal:Saving configuration 2021-07-26T15:24:08.711 INFO:teuthology.run_tasks:Running task internal.check_lock... 2021-07-26T15:24:08.723 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-07-26T15:24:08.740 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-07-26 15:18:48.217204', 'description': '/home/teuthworker/archive/sage-2021-07-26_15:05:01-upgrade-wip-kefu-testing-2021-07-24-1158-distro-basic-smithi/6293836', 'locked_by': 'scheduled_sage@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJ7L3SWIIRtXuZ7S32MRNhvQ1xe58WYXj3JASwHC+GYd', 'os_version': '20.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi183.front.sepia.ceph.com'} 2021-07-26T15:24:08.756 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-07-26 15:18:48.217167', 'description': '/home/teuthworker/archive/sage-2021-07-26_15:05:01-upgrade-wip-kefu-testing-2021-07-24-1158-distro-basic-smithi/6293836', 'locked_by': 'scheduled_sage@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIMVFXe6S+mPQwopjvG4PFtz3L4loNMNdDrFndPndFjrE', 'os_version': '20.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi197.front.sepia.ceph.com'} 2021-07-26T15:24:08.756 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2021-07-26T15:24:08.768 INFO:teuthology.task.internal:roles: ubuntu@smithi183.front.sepia.ceph.com - ['c1.mon.a', 'c1.mgr.x', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0'] 2021-07-26T15:24:08.768 INFO:teuthology.task.internal:roles: ubuntu@smithi197.front.sepia.ceph.com - ['c2.mon.a', 'c2.mgr.x', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0', 'c2.client.1'] 2021-07-26T15:24:08.768 INFO:teuthology.run_tasks:Running task console_log... 2021-07-26T15:24:08.837 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f0b9d06ef28>, signals=[15]) 2021-07-26T15:24:08.838 INFO:teuthology.run_tasks:Running task internal.connect... 2021-07-26T15:24:08.849 INFO:teuthology.task.internal:Opening connections... 2021-07-26T15:24:08.850 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi183.front.sepia.ceph.com 2021-07-26T15:24:08.853 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-26T15:24:08.904 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi197.front.sepia.ceph.com 2021-07-26T15:24:08.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi197.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-26T15:24:08.952 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2021-07-26T15:24:08.962 DEBUG:teuthology.orchestra.run.smithi183:> uname -m 2021-07-26T15:24:08.983 INFO:teuthology.orchestra.run.smithi183.stdout:x86_64 2021-07-26T15:24:08.983 DEBUG:teuthology.orchestra.run.smithi183:> cat /etc/os-release 2021-07-26T15:24:09.033 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="Ubuntu" 2021-07-26T15:24:09.033 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="20.04.2 LTS (Focal Fossa)" 2021-07-26T15:24:09.033 INFO:teuthology.orchestra.run.smithi183.stdout:ID=ubuntu 2021-07-26T15:24:09.034 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE=debian 2021-07-26T15:24:09.034 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS" 2021-07-26T15:24:09.034 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="20.04" 2021-07-26T15:24:09.034 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://www.ubuntu.com/" 2021-07-26T15:24:09.035 INFO:teuthology.orchestra.run.smithi183.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-07-26T15:24:09.035 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-07-26T15:24:09.035 INFO:teuthology.orchestra.run.smithi183.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-07-26T15:24:09.035 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_CODENAME=focal 2021-07-26T15:24:09.036 INFO:teuthology.orchestra.run.smithi183.stdout:UBUNTU_CODENAME=focal 2021-07-26T15:24:09.036 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server 2021-07-26T15:24:09.053 DEBUG:teuthology.orchestra.run.smithi197:> uname -m 2021-07-26T15:24:09.060 INFO:teuthology.orchestra.run.smithi197.stdout:x86_64 2021-07-26T15:24:09.061 DEBUG:teuthology.orchestra.run.smithi197:> cat /etc/os-release 2021-07-26T15:24:09.066 INFO:teuthology.orchestra.run.smithi197.stdout:NAME="Ubuntu" 2021-07-26T15:24:09.067 INFO:teuthology.orchestra.run.smithi197.stdout:VERSION="20.04.2 LTS (Focal Fossa)" 2021-07-26T15:24:09.067 INFO:teuthology.orchestra.run.smithi197.stdout:ID=ubuntu 2021-07-26T15:24:09.067 INFO:teuthology.orchestra.run.smithi197.stdout:ID_LIKE=debian 2021-07-26T15:24:09.067 INFO:teuthology.orchestra.run.smithi197.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS" 2021-07-26T15:24:09.068 INFO:teuthology.orchestra.run.smithi197.stdout:VERSION_ID="20.04" 2021-07-26T15:24:09.068 INFO:teuthology.orchestra.run.smithi197.stdout:HOME_URL="https://www.ubuntu.com/" 2021-07-26T15:24:09.068 INFO:teuthology.orchestra.run.smithi197.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-07-26T15:24:09.068 INFO:teuthology.orchestra.run.smithi197.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-07-26T15:24:09.068 INFO:teuthology.orchestra.run.smithi197.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-07-26T15:24:09.069 INFO:teuthology.orchestra.run.smithi197.stdout:VERSION_CODENAME=focal 2021-07-26T15:24:09.069 INFO:teuthology.orchestra.run.smithi197.stdout:UBUNTU_CODENAME=focal 2021-07-26T15:24:09.069 INFO:teuthology.lock.ops:Updating smithi197.front.sepia.ceph.com on lock server 2021-07-26T15:24:09.084 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2021-07-26T15:24:09.098 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2021-07-26T15:24:09.120 INFO:teuthology.task.internal:Checking for old test directory... 2021-07-26T15:24:09.121 DEBUG:teuthology.orchestra.run.smithi183:> test '!' -e /home/ubuntu/cephtest 2021-07-26T15:24:09.124 DEBUG:teuthology.orchestra.run.smithi197:> test '!' -e /home/ubuntu/cephtest 2021-07-26T15:24:09.129 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2021-07-26T15:24:09.142 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2021-07-26T15:24:09.143 DEBUG:teuthology.orchestra.run.smithi183:> test -z $(ls -A /var/lib/ceph) 2021-07-26T15:24:09.172 DEBUG:teuthology.orchestra.run.smithi197:> test -z $(ls -A /var/lib/ceph) 2021-07-26T15:24:09.181 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2021-07-26T15:24:09.227 INFO:teuthology.run_tasks:Running task kernel... 2021-07-26T15:24:09.244 DEBUG:teuthology.task.kernel:normalized config {'c1.mon.a': {'kdb': True, 'sha1': 'distro'}, 'c1.mgr.x': {'kdb': True, 'sha1': 'distro'}, 'c1.osd.0': {'kdb': True, 'sha1': 'distro'}, 'c1.osd.1': {'kdb': True, 'sha1': 'distro'}, 'c1.osd.2': {'kdb': True, 'sha1': 'distro'}, 'c1.client.0': {'kdb': True, 'sha1': 'distro'}, 'c2.mon.a': {'kdb': True, 'sha1': 'distro'}, 'c2.mgr.x': {'kdb': True, 'sha1': 'distro'}, 'c2.osd.0': {'kdb': True, 'sha1': 'distro'}, 'c2.osd.1': {'kdb': True, 'sha1': 'distro'}, 'c2.osd.2': {'kdb': True, 'sha1': 'distro'}, 'c2.client.0': {'kdb': True, 'sha1': 'distro'}, 'c2.client.1': {'kdb': True, 'sha1': 'distro'}} 2021-07-26T15:24:09.245 INFO:teuthology.task.kernel:config {'c1.mon.a': {'kdb': True, 'sha1': 'distro'}, 'c2.mon.a': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2021-07-26T15:24:09.246 DEBUG:teuthology.orchestra.run.smithi183:> uname -r 2021-07-26T15:24:09.253 INFO:teuthology.orchestra.run.smithi183.stdout:5.4.0-66-generic 2021-07-26T15:24:09.253 INFO:teuthology.task.kernel:Running kernel on smithi183: 5.4.0-66-generic 2021-07-26T15:24:09.253 DEBUG:teuthology.orchestra.run.smithi183:> sudo apt-get clean 2021-07-26T15:24:09.342 DEBUG:teuthology.orchestra.run.smithi183:> sudo apt-get update 2021-07-26T15:24:09.520 INFO:teuthology.orchestra.run.smithi183.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2021-07-26T15:24:09.632 INFO:teuthology.orchestra.run.smithi183.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-07-26T15:24:09.715 INFO:teuthology.orchestra.run.smithi183.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-07-26T15:24:09.795 INFO:teuthology.orchestra.run.smithi183.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [789 kB] 2021-07-26T15:24:09.876 INFO:teuthology.orchestra.run.smithi183.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [268 kB] 2021-07-26T15:24:09.881 INFO:teuthology.orchestra.run.smithi183.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [155 kB] 2021-07-26T15:24:09.883 INFO:teuthology.orchestra.run.smithi183.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [8,304 B] 2021-07-26T15:24:09.884 INFO:teuthology.orchestra.run.smithi183.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [327 kB] 2021-07-26T15:24:09.887 INFO:teuthology.orchestra.run.smithi183.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [16.5 kB] 2021-07-26T15:24:09.888 INFO:teuthology.orchestra.run.smithi183.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [47.4 kB] 2021-07-26T15:24:09.889 INFO:teuthology.orchestra.run.smithi183.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [428 B] 2021-07-26T15:24:09.889 INFO:teuthology.orchestra.run.smithi183.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [633 kB] 2021-07-26T15:24:09.901 INFO:teuthology.orchestra.run.smithi183.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [505 kB] 2021-07-26T15:24:09.907 INFO:teuthology.orchestra.run.smithi183.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [97.5 kB] 2021-07-26T15:24:09.908 INFO:teuthology.orchestra.run.smithi183.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [11.9 kB] 2021-07-26T15:24:09.921 INFO:teuthology.orchestra.run.smithi183.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [25.4 kB] 2021-07-26T15:24:09.921 INFO:teuthology.orchestra.run.smithi183.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,912 B] 2021-07-26T15:24:09.922 INFO:teuthology.orchestra.run.smithi183.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [4,952 B] 2021-07-26T15:24:09.922 INFO:teuthology.orchestra.run.smithi183.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [600 B] 2021-07-26T15:24:10.052 INFO:teuthology.orchestra.run.smithi183.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-07-26T15:24:10.178 INFO:teuthology.orchestra.run.smithi183.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [511 kB] 2021-07-26T15:24:10.399 INFO:teuthology.orchestra.run.smithi183.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [1,126 kB] 2021-07-26T15:24:10.548 INFO:teuthology.orchestra.run.smithi183.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [245 kB] 2021-07-26T15:24:10.566 INFO:teuthology.orchestra.run.smithi183.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [13.8 kB] 2021-07-26T15:24:10.566 INFO:teuthology.orchestra.run.smithi183.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [364 kB] 2021-07-26T15:24:10.579 INFO:teuthology.orchestra.run.smithi183.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [17.8 kB] 2021-07-26T15:24:10.581 INFO:teuthology.orchestra.run.smithi183.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [52.7 kB] 2021-07-26T15:24:10.584 INFO:teuthology.orchestra.run.smithi183.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [428 B] 2021-07-26T15:24:10.584 INFO:teuthology.orchestra.run.smithi183.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [843 kB] 2021-07-26T15:24:10.635 INFO:teuthology.orchestra.run.smithi183.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [626 kB] 2021-07-26T15:24:10.657 INFO:teuthology.orchestra.run.smithi183.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [176 kB] 2021-07-26T15:24:10.661 INFO:teuthology.orchestra.run.smithi183.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [18.4 kB] 2021-07-26T15:24:10.667 INFO:teuthology.orchestra.run.smithi183.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [27.4 kB] 2021-07-26T15:24:10.667 INFO:teuthology.orchestra.run.smithi183.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,912 B] 2021-07-26T15:24:10.668 INFO:teuthology.orchestra.run.smithi183.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [6,780 B] 2021-07-26T15:24:10.715 INFO:teuthology.orchestra.run.smithi183.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [676 B] 2021-07-26T15:24:10.715 INFO:teuthology.orchestra.run.smithi183.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [2,568 B] 2021-07-26T15:24:10.715 INFO:teuthology.orchestra.run.smithi183.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [2,568 B] 2021-07-26T15:24:10.751 INFO:teuthology.orchestra.run.smithi183.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main Translation-en [1,120 B] 2021-07-26T15:24:10.752 INFO:teuthology.orchestra.run.smithi183.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [400 B] 2021-07-26T15:24:10.752 INFO:teuthology.orchestra.run.smithi183.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [5,792 B] 2021-07-26T15:24:10.752 INFO:teuthology.orchestra.run.smithi183.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [4,724 B] 2021-07-26T15:24:10.796 INFO:teuthology.orchestra.run.smithi183.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal-backports/universe Translation-en [2,060 B] 2021-07-26T15:24:10.796 INFO:teuthology.orchestra.run.smithi183.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [288 B] 2021-07-26T15:24:13.802 INFO:teuthology.orchestra.run.smithi183.stdout:Fetched 7,282 kB in 2s (4,793 kB/s) 2021-07-26T15:24:14.949 INFO:teuthology.orchestra.run.smithi183.stdout:Reading package lists... 2021-07-26T15:24:14.972 DEBUG:teuthology.orchestra.run.smithi183:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-07-26T15:24:15.032 INFO:teuthology.orchestra.run.smithi183.stdout:Reading package lists... 2021-07-26T15:24:15.175 INFO:teuthology.orchestra.run.smithi183.stdout:Building dependency tree... 2021-07-26T15:24:15.176 INFO:teuthology.orchestra.run.smithi183.stdout:Reading state information... 2021-07-26T15:24:15.244 INFO:teuthology.orchestra.run.smithi183.stderr:E: Unable to locate package linux-image-current-generic 2021-07-26T15:24:15.246 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-07-26T15:24:15.247 DEBUG:teuthology.orchestra.run.smithi183:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-07-26T15:24:15.313 INFO:teuthology.orchestra.run.smithi183.stdout:Reading package lists... 2021-07-26T15:24:15.457 INFO:teuthology.orchestra.run.smithi183.stdout:Building dependency tree... 2021-07-26T15:24:15.458 INFO:teuthology.orchestra.run.smithi183.stdout:Reading state information... 2021-07-26T15:24:15.584 INFO:teuthology.orchestra.run.smithi183.stdout:The following additional packages will be installed: 2021-07-26T15:24:15.585 INFO:teuthology.orchestra.run.smithi183.stdout: linux-generic linux-headers-5.4.0-80 linux-headers-5.4.0-80-generic 2021-07-26T15:24:15.585 INFO:teuthology.orchestra.run.smithi183.stdout: linux-headers-generic linux-image-5.4.0-80-generic 2021-07-26T15:24:15.585 INFO:teuthology.orchestra.run.smithi183.stdout: linux-modules-5.4.0-80-generic linux-modules-extra-5.4.0-80-generic 2021-07-26T15:24:15.587 INFO:teuthology.orchestra.run.smithi183.stdout:Suggested packages: 2021-07-26T15:24:15.587 INFO:teuthology.orchestra.run.smithi183.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2021-07-26T15:24:15.587 INFO:teuthology.orchestra.run.smithi183.stdout:Recommended packages: 2021-07-26T15:24:15.588 INFO:teuthology.orchestra.run.smithi183.stdout: thermald 2021-07-26T15:24:15.613 INFO:teuthology.orchestra.run.smithi183.stdout:The following NEW packages will be installed: 2021-07-26T15:24:15.614 INFO:teuthology.orchestra.run.smithi183.stdout: linux-headers-5.4.0-80 linux-headers-5.4.0-80-generic 2021-07-26T15:24:15.614 INFO:teuthology.orchestra.run.smithi183.stdout: linux-image-5.4.0-80-generic linux-modules-5.4.0-80-generic 2021-07-26T15:24:15.614 INFO:teuthology.orchestra.run.smithi183.stdout: linux-modules-extra-5.4.0-80-generic 2021-07-26T15:24:15.615 INFO:teuthology.orchestra.run.smithi183.stdout:The following packages will be upgraded: 2021-07-26T15:24:15.615 INFO:teuthology.orchestra.run.smithi183.stdout: linux-generic linux-headers-generic linux-image-generic 2021-07-26T15:24:15.795 INFO:teuthology.orchestra.run.smithi183.stdout:3 upgraded, 5 newly installed, 0 to remove and 160 not upgraded. 2021-07-26T15:24:15.795 INFO:teuthology.orchestra.run.smithi183.stdout:Need to get 75.6 MB of archives. 2021-07-26T15:24:15.795 INFO:teuthology.orchestra.run.smithi183.stdout:After this operation, 377 MB of additional disk space will be used. 2021-07-26T15:24:15.796 INFO:teuthology.orchestra.run.smithi183.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-80-generic amd64 5.4.0-80.90 [14.8 MB] 2021-07-26T15:24:16.940 INFO:teuthology.orchestra.run.smithi183.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-80-generic amd64 5.4.0-80.90 [8,976 kB] 2021-07-26T15:24:17.148 INFO:teuthology.orchestra.run.smithi183.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-80-generic amd64 5.4.0-80.90 [39.4 MB] 2021-07-26T15:24:18.413 INFO:teuthology.orchestra.run.smithi183.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.80.84 [1,900 B] 2021-07-26T15:24:18.413 INFO:teuthology.orchestra.run.smithi183.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.80.84 [2,568 B] 2021-07-26T15:24:18.414 INFO:teuthology.orchestra.run.smithi183.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-80 all 5.4.0-80.90 [11.0 MB] 2021-07-26T15:24:18.696 INFO:teuthology.orchestra.run.smithi183.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-80-generic amd64 5.4.0-80.90 [1,410 kB] 2021-07-26T15:24:18.756 INFO:teuthology.orchestra.run.smithi183.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.80.84 [2,436 B] 2021-07-26T15:24:19.154 INFO:teuthology.orchestra.run.smithi183.stdout:Fetched 75.6 MB in 3s (24.1 MB/s) 2021-07-26T15:24:19.321 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package linux-modules-5.4.0-80-generic. 2021-07-26T15:24:20.756 INFO:teuthology.orchestra.run.smithi183.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 101691 files and directories currently installed.) 2021-07-26T15:24:20.760 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../0-linux-modules-5.4.0-80-generic_5.4.0-80.90_amd64.deb ... 2021-07-26T15:24:20.851 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking linux-modules-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:24:22.794 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package linux-image-5.4.0-80-generic. 2021-07-26T15:24:22.810 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../1-linux-image-5.4.0-80-generic_5.4.0-80.90_amd64.deb ... 2021-07-26T15:24:22.918 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking linux-image-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:24:23.928 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-80-generic. 2021-07-26T15:24:23.945 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-80-generic_5.4.0-80.90_amd64.deb ... 2021-07-26T15:24:23.991 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking linux-modules-extra-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:24:29.238 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../3-linux-generic_5.4.0.80.84_amd64.deb ... 2021-07-26T15:24:29.387 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking linux-generic (5.4.0.80.84) over (5.4.0.66.69) ... 2021-07-26T15:24:29.720 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.80.84_amd64.deb ... 2021-07-26T15:24:29.848 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking linux-image-generic (5.4.0.80.84) over (5.4.0.66.69) ... 2021-07-26T15:24:30.181 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package linux-headers-5.4.0-80. 2021-07-26T15:24:30.195 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../5-linux-headers-5.4.0-80_5.4.0-80.90_all.deb ... 2021-07-26T15:24:30.240 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking linux-headers-5.4.0-80 (5.4.0-80.90) ... 2021-07-26T15:24:36.878 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package linux-headers-5.4.0-80-generic. 2021-07-26T15:24:36.900 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../6-linux-headers-5.4.0-80-generic_5.4.0-80.90_amd64.deb ... 2021-07-26T15:24:36.944 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking linux-headers-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:24:39.556 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.80.84_amd64.deb ... 2021-07-26T15:24:39.693 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking linux-headers-generic (5.4.0.80.84) over (5.4.0.66.69) ... 2021-07-26T15:24:40.025 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up linux-modules-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:24:41.206 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up linux-headers-5.4.0-80 (5.4.0-80.90) ... 2021-07-26T15:24:41.333 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up linux-image-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:24:42.467 INFO:teuthology.orchestra.run.smithi183.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-80-generic 2021-07-26T15:24:42.467 INFO:teuthology.orchestra.run.smithi183.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-80-generic 2021-07-26T15:24:42.601 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up linux-headers-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:24:42.707 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up linux-modules-extra-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:24:43.854 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up linux-image-generic (5.4.0.80.84) ... 2021-07-26T15:24:43.981 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up linux-headers-generic (5.4.0.80.84) ... 2021-07-26T15:24:44.340 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up linux-generic (5.4.0.80.84) ... 2021-07-26T15:24:44.701 INFO:teuthology.orchestra.run.smithi183.stdout:Processing triggers for linux-image-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:24:44.876 INFO:teuthology.orchestra.run.smithi183.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-07-26T15:24:44.876 INFO:teuthology.orchestra.run.smithi183.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-80-generic 2021-07-26T15:25:06.724 INFO:teuthology.orchestra.run.smithi183.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-07-26T15:25:06.725 INFO:teuthology.orchestra.run.smithi183.stdout:Sourcing file `/etc/default/grub' 2021-07-26T15:25:06.739 INFO:teuthology.orchestra.run.smithi183.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-07-26T15:25:06.781 INFO:teuthology.orchestra.run.smithi183.stdout:Generating grub configuration file ... 2021-07-26T15:25:07.171 INFO:teuthology.orchestra.run.smithi183.stdout:Found linux image: /boot/vmlinuz-5.4.0-80-generic 2021-07-26T15:25:07.206 INFO:teuthology.orchestra.run.smithi183.stdout:Found initrd image: /boot/initrd.img-5.4.0-80-generic 2021-07-26T15:25:07.611 INFO:teuthology.orchestra.run.smithi183.stdout:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-07-26T15:25:07.622 INFO:teuthology.orchestra.run.smithi183.stdout:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-07-26T15:25:09.363 INFO:teuthology.orchestra.run.smithi183.stdout:done 2021-07-26T15:25:09.680 DEBUG:teuthology.orchestra.run.smithi183:> dpkg -s linux-image-generic 2021-07-26T15:25:09.716 INFO:teuthology.orchestra.run.smithi183.stdout:Package: linux-image-generic 2021-07-26T15:25:09.717 INFO:teuthology.orchestra.run.smithi183.stdout:Status: install ok installed 2021-07-26T15:25:09.717 INFO:teuthology.orchestra.run.smithi183.stdout:Priority: optional 2021-07-26T15:25:09.717 INFO:teuthology.orchestra.run.smithi183.stdout:Section: kernel 2021-07-26T15:25:09.717 INFO:teuthology.orchestra.run.smithi183.stdout:Installed-Size: 18 2021-07-26T15:25:09.718 INFO:teuthology.orchestra.run.smithi183.stdout:Maintainer: Ubuntu Kernel Team 2021-07-26T15:25:09.718 INFO:teuthology.orchestra.run.smithi183.stdout:Architecture: amd64 2021-07-26T15:25:09.718 INFO:teuthology.orchestra.run.smithi183.stdout:Source: linux-meta 2021-07-26T15:25:09.718 INFO:teuthology.orchestra.run.smithi183.stdout:Version: 5.4.0.80.84 2021-07-26T15:25:09.719 INFO:teuthology.orchestra.run.smithi183.stdout:Provides: virtualbox-guest-modules (= 6.1.16-dfsg-6~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.10) 2021-07-26T15:25:09.719 INFO:teuthology.orchestra.run.smithi183.stdout:Depends: linux-image-5.4.0-80-generic, linux-modules-extra-5.4.0-80-generic, linux-firmware, intel-microcode, amd64-microcode 2021-07-26T15:25:09.719 INFO:teuthology.orchestra.run.smithi183.stdout:Recommends: thermald 2021-07-26T15:25:09.719 INFO:teuthology.orchestra.run.smithi183.stdout:Description: Generic Linux kernel image 2021-07-26T15:25:09.720 INFO:teuthology.orchestra.run.smithi183.stdout: This package will always depend on the latest generic kernel image 2021-07-26T15:25:09.720 INFO:teuthology.orchestra.run.smithi183.stdout: available. 2021-07-26T15:25:09.720 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-66-generic Expected: 5.4.0-80-generic 2021-07-26T15:25:09.722 DEBUG:teuthology.orchestra.run.smithi197:> uname -r 2021-07-26T15:25:09.730 INFO:teuthology.orchestra.run.smithi197.stdout:5.4.0-66-generic 2021-07-26T15:25:09.730 INFO:teuthology.task.kernel:Running kernel on smithi197: 5.4.0-66-generic 2021-07-26T15:25:09.730 DEBUG:teuthology.orchestra.run.smithi197:> sudo apt-get clean 2021-07-26T15:25:09.839 DEBUG:teuthology.orchestra.run.smithi197:> sudo apt-get update 2021-07-26T15:25:10.009 INFO:teuthology.orchestra.run.smithi197.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2021-07-26T15:25:10.128 INFO:teuthology.orchestra.run.smithi197.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-07-26T15:25:10.212 INFO:teuthology.orchestra.run.smithi197.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-07-26T15:25:10.321 INFO:teuthology.orchestra.run.smithi197.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [268 kB] 2021-07-26T15:25:10.380 INFO:teuthology.orchestra.run.smithi197.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [789 kB] 2021-07-26T15:25:10.411 INFO:teuthology.orchestra.run.smithi197.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [155 kB] 2021-07-26T15:25:10.415 INFO:teuthology.orchestra.run.smithi197.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [8,304 B] 2021-07-26T15:25:10.416 INFO:teuthology.orchestra.run.smithi197.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [16.5 kB] 2021-07-26T15:25:10.416 INFO:teuthology.orchestra.run.smithi197.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [327 kB] 2021-07-26T15:25:10.420 INFO:teuthology.orchestra.run.smithi197.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [47.4 kB] 2021-07-26T15:25:10.421 INFO:teuthology.orchestra.run.smithi197.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [428 B] 2021-07-26T15:25:10.421 INFO:teuthology.orchestra.run.smithi197.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [633 kB] 2021-07-26T15:25:10.430 INFO:teuthology.orchestra.run.smithi197.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [505 kB] 2021-07-26T15:25:10.435 INFO:teuthology.orchestra.run.smithi197.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [97.5 kB] 2021-07-26T15:25:10.436 INFO:teuthology.orchestra.run.smithi197.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [11.9 kB] 2021-07-26T15:25:10.449 INFO:teuthology.orchestra.run.smithi197.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [25.4 kB] 2021-07-26T15:25:10.450 INFO:teuthology.orchestra.run.smithi197.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,912 B] 2021-07-26T15:25:10.450 INFO:teuthology.orchestra.run.smithi197.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [4,952 B] 2021-07-26T15:25:10.450 INFO:teuthology.orchestra.run.smithi197.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [600 B] 2021-07-26T15:25:10.555 INFO:teuthology.orchestra.run.smithi197.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-07-26T15:25:10.686 INFO:teuthology.orchestra.run.smithi197.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [1,126 kB] 2021-07-26T15:25:11.010 INFO:teuthology.orchestra.run.smithi197.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [511 kB] 2021-07-26T15:25:11.023 INFO:teuthology.orchestra.run.smithi197.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [245 kB] 2021-07-26T15:25:11.031 INFO:teuthology.orchestra.run.smithi197.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [13.8 kB] 2021-07-26T15:25:11.031 INFO:teuthology.orchestra.run.smithi197.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [364 kB] 2021-07-26T15:25:11.043 INFO:teuthology.orchestra.run.smithi197.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [17.8 kB] 2021-07-26T15:25:11.044 INFO:teuthology.orchestra.run.smithi197.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [52.7 kB] 2021-07-26T15:25:11.045 INFO:teuthology.orchestra.run.smithi197.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [428 B] 2021-07-26T15:25:11.046 INFO:teuthology.orchestra.run.smithi197.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [626 kB] 2021-07-26T15:25:11.108 INFO:teuthology.orchestra.run.smithi197.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [843 kB] 2021-07-26T15:25:11.136 INFO:teuthology.orchestra.run.smithi197.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [176 kB] 2021-07-26T15:25:11.138 INFO:teuthology.orchestra.run.smithi197.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [18.4 kB] 2021-07-26T15:25:11.139 INFO:teuthology.orchestra.run.smithi197.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [27.4 kB] 2021-07-26T15:25:11.140 INFO:teuthology.orchestra.run.smithi197.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,912 B] 2021-07-26T15:25:11.140 INFO:teuthology.orchestra.run.smithi197.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [6,780 B] 2021-07-26T15:25:11.192 INFO:teuthology.orchestra.run.smithi197.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [676 B] 2021-07-26T15:25:11.192 INFO:teuthology.orchestra.run.smithi197.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [2,568 B] 2021-07-26T15:25:11.193 INFO:teuthology.orchestra.run.smithi197.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [2,568 B] 2021-07-26T15:25:11.193 INFO:teuthology.orchestra.run.smithi197.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main Translation-en [1,120 B] 2021-07-26T15:25:11.274 INFO:teuthology.orchestra.run.smithi197.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [400 B] 2021-07-26T15:25:11.275 INFO:teuthology.orchestra.run.smithi197.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [4,724 B] 2021-07-26T15:25:11.276 INFO:teuthology.orchestra.run.smithi197.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [5,792 B] 2021-07-26T15:25:11.276 INFO:teuthology.orchestra.run.smithi197.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal-backports/universe Translation-en [2,060 B] 2021-07-26T15:25:11.276 INFO:teuthology.orchestra.run.smithi197.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [288 B] 2021-07-26T15:25:14.184 INFO:teuthology.orchestra.run.smithi197.stdout:Fetched 7,282 kB in 1s (5,024 kB/s) 2021-07-26T15:25:15.297 INFO:teuthology.orchestra.run.smithi197.stdout:Reading package lists... 2021-07-26T15:25:15.318 DEBUG:teuthology.orchestra.run.smithi197:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-07-26T15:25:15.382 INFO:teuthology.orchestra.run.smithi197.stdout:Reading package lists... 2021-07-26T15:25:15.539 INFO:teuthology.orchestra.run.smithi197.stdout:Building dependency tree... 2021-07-26T15:25:15.540 INFO:teuthology.orchestra.run.smithi197.stdout:Reading state information... 2021-07-26T15:25:15.618 INFO:teuthology.orchestra.run.smithi197.stderr:E: Unable to locate package linux-image-current-generic 2021-07-26T15:25:15.619 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-07-26T15:25:15.621 DEBUG:teuthology.orchestra.run.smithi197:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-07-26T15:25:15.690 INFO:teuthology.orchestra.run.smithi197.stdout:Reading package lists... 2021-07-26T15:25:15.848 INFO:teuthology.orchestra.run.smithi197.stdout:Building dependency tree... 2021-07-26T15:25:15.849 INFO:teuthology.orchestra.run.smithi197.stdout:Reading state information... 2021-07-26T15:25:15.990 INFO:teuthology.orchestra.run.smithi197.stdout:The following additional packages will be installed: 2021-07-26T15:25:15.991 INFO:teuthology.orchestra.run.smithi197.stdout: linux-generic linux-headers-5.4.0-80 linux-headers-5.4.0-80-generic 2021-07-26T15:25:15.991 INFO:teuthology.orchestra.run.smithi197.stdout: linux-headers-generic linux-image-5.4.0-80-generic 2021-07-26T15:25:15.991 INFO:teuthology.orchestra.run.smithi197.stdout: linux-modules-5.4.0-80-generic linux-modules-extra-5.4.0-80-generic 2021-07-26T15:25:15.992 INFO:teuthology.orchestra.run.smithi197.stdout:Suggested packages: 2021-07-26T15:25:15.992 INFO:teuthology.orchestra.run.smithi197.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2021-07-26T15:25:15.992 INFO:teuthology.orchestra.run.smithi197.stdout:Recommended packages: 2021-07-26T15:25:15.993 INFO:teuthology.orchestra.run.smithi197.stdout: thermald 2021-07-26T15:25:16.021 INFO:teuthology.orchestra.run.smithi197.stdout:The following NEW packages will be installed: 2021-07-26T15:25:16.022 INFO:teuthology.orchestra.run.smithi197.stdout: linux-headers-5.4.0-80 linux-headers-5.4.0-80-generic 2021-07-26T15:25:16.022 INFO:teuthology.orchestra.run.smithi197.stdout: linux-image-5.4.0-80-generic linux-modules-5.4.0-80-generic 2021-07-26T15:25:16.022 INFO:teuthology.orchestra.run.smithi197.stdout: linux-modules-extra-5.4.0-80-generic 2021-07-26T15:25:16.023 INFO:teuthology.orchestra.run.smithi197.stdout:The following packages will be upgraded: 2021-07-26T15:25:16.023 INFO:teuthology.orchestra.run.smithi197.stdout: linux-generic linux-headers-generic linux-image-generic 2021-07-26T15:25:16.205 INFO:teuthology.orchestra.run.smithi197.stdout:3 upgraded, 5 newly installed, 0 to remove and 160 not upgraded. 2021-07-26T15:25:16.205 INFO:teuthology.orchestra.run.smithi197.stdout:Need to get 75.6 MB of archives. 2021-07-26T15:25:16.205 INFO:teuthology.orchestra.run.smithi197.stdout:After this operation, 377 MB of additional disk space will be used. 2021-07-26T15:25:16.206 INFO:teuthology.orchestra.run.smithi197.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-80-generic amd64 5.4.0-80.90 [14.8 MB] 2021-07-26T15:25:17.320 INFO:teuthology.orchestra.run.smithi197.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-80-generic amd64 5.4.0-80.90 [8,976 kB] 2021-07-26T15:25:17.533 INFO:teuthology.orchestra.run.smithi197.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-80-generic amd64 5.4.0-80.90 [39.4 MB] 2021-07-26T15:25:18.899 INFO:teuthology.orchestra.run.smithi197.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.80.84 [1,900 B] 2021-07-26T15:25:18.899 INFO:teuthology.orchestra.run.smithi197.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.80.84 [2,568 B] 2021-07-26T15:25:18.899 INFO:teuthology.orchestra.run.smithi197.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-80 all 5.4.0-80.90 [11.0 MB] 2021-07-26T15:25:19.265 INFO:teuthology.orchestra.run.smithi197.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-80-generic amd64 5.4.0-80.90 [1,410 kB] 2021-07-26T15:25:19.284 INFO:teuthology.orchestra.run.smithi197.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.80.84 [2,436 B] 2021-07-26T15:25:19.685 INFO:teuthology.orchestra.run.smithi197.stdout:Fetched 75.6 MB in 3s (23.2 MB/s) 2021-07-26T15:25:19.822 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package linux-modules-5.4.0-80-generic. 2021-07-26T15:25:21.281 INFO:teuthology.orchestra.run.smithi197.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 101691 files and directories currently installed.) 2021-07-26T15:25:21.286 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../0-linux-modules-5.4.0-80-generic_5.4.0-80.90_amd64.deb ... 2021-07-26T15:25:21.393 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking linux-modules-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:25:23.400 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package linux-image-5.4.0-80-generic. 2021-07-26T15:25:23.416 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../1-linux-image-5.4.0-80-generic_5.4.0-80.90_amd64.deb ... 2021-07-26T15:25:23.513 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking linux-image-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:25:24.533 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-80-generic. 2021-07-26T15:25:24.545 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-80-generic_5.4.0-80.90_amd64.deb ... 2021-07-26T15:25:24.586 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking linux-modules-extra-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:25:29.543 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../3-linux-generic_5.4.0.80.84_amd64.deb ... 2021-07-26T15:25:29.686 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking linux-generic (5.4.0.80.84) over (5.4.0.66.69) ... 2021-07-26T15:25:30.005 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.80.84_amd64.deb ... 2021-07-26T15:25:30.133 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking linux-image-generic (5.4.0.80.84) over (5.4.0.66.69) ... 2021-07-26T15:25:30.487 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package linux-headers-5.4.0-80. 2021-07-26T15:25:30.498 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../5-linux-headers-5.4.0-80_5.4.0-80.90_all.deb ... 2021-07-26T15:25:30.543 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking linux-headers-5.4.0-80 (5.4.0-80.90) ... 2021-07-26T15:25:36.891 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package linux-headers-5.4.0-80-generic. 2021-07-26T15:25:36.912 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../6-linux-headers-5.4.0-80-generic_5.4.0-80.90_amd64.deb ... 2021-07-26T15:25:36.957 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking linux-headers-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:25:39.479 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.80.84_amd64.deb ... 2021-07-26T15:25:39.615 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking linux-headers-generic (5.4.0.80.84) over (5.4.0.66.69) ... 2021-07-26T15:25:39.988 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up linux-modules-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:25:41.163 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up linux-headers-5.4.0-80 (5.4.0-80.90) ... 2021-07-26T15:25:41.315 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up linux-image-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:25:42.437 INFO:teuthology.orchestra.run.smithi197.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-80-generic 2021-07-26T15:25:42.437 INFO:teuthology.orchestra.run.smithi197.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-80-generic 2021-07-26T15:25:42.599 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up linux-headers-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:25:42.727 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up linux-modules-extra-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:25:43.869 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up linux-image-generic (5.4.0.80.84) ... 2021-07-26T15:25:43.978 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up linux-headers-generic (5.4.0.80.84) ... 2021-07-26T15:25:44.601 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up linux-generic (5.4.0.80.84) ... 2021-07-26T15:25:45.456 INFO:teuthology.orchestra.run.smithi197.stdout:Processing triggers for linux-image-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:25:46.097 INFO:teuthology.orchestra.run.smithi197.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-07-26T15:25:46.098 INFO:teuthology.orchestra.run.smithi197.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-80-generic 2021-07-26T15:26:07.637 INFO:teuthology.orchestra.run.smithi197.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-07-26T15:26:07.637 INFO:teuthology.orchestra.run.smithi197.stdout:Sourcing file `/etc/default/grub' 2021-07-26T15:26:07.644 INFO:teuthology.orchestra.run.smithi197.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-07-26T15:26:07.669 INFO:teuthology.orchestra.run.smithi197.stdout:Generating grub configuration file ... 2021-07-26T15:26:07.983 INFO:teuthology.orchestra.run.smithi197.stdout:Found linux image: /boot/vmlinuz-5.4.0-80-generic 2021-07-26T15:26:08.006 INFO:teuthology.orchestra.run.smithi197.stdout:Found initrd image: /boot/initrd.img-5.4.0-80-generic 2021-07-26T15:26:08.409 INFO:teuthology.orchestra.run.smithi197.stdout:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-07-26T15:26:08.420 INFO:teuthology.orchestra.run.smithi197.stdout:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-07-26T15:26:10.162 INFO:teuthology.orchestra.run.smithi197.stdout:done 2021-07-26T15:26:10.504 DEBUG:teuthology.orchestra.run.smithi197:> dpkg -s linux-image-generic 2021-07-26T15:26:10.544 INFO:teuthology.orchestra.run.smithi197.stdout:Package: linux-image-generic 2021-07-26T15:26:10.545 INFO:teuthology.orchestra.run.smithi197.stdout:Status: install ok installed 2021-07-26T15:26:10.545 INFO:teuthology.orchestra.run.smithi197.stdout:Priority: optional 2021-07-26T15:26:10.546 INFO:teuthology.orchestra.run.smithi197.stdout:Section: kernel 2021-07-26T15:26:10.546 INFO:teuthology.orchestra.run.smithi197.stdout:Installed-Size: 18 2021-07-26T15:26:10.546 INFO:teuthology.orchestra.run.smithi197.stdout:Maintainer: Ubuntu Kernel Team 2021-07-26T15:26:10.546 INFO:teuthology.orchestra.run.smithi197.stdout:Architecture: amd64 2021-07-26T15:26:10.546 INFO:teuthology.orchestra.run.smithi197.stdout:Source: linux-meta 2021-07-26T15:26:10.547 INFO:teuthology.orchestra.run.smithi197.stdout:Version: 5.4.0.80.84 2021-07-26T15:26:10.547 INFO:teuthology.orchestra.run.smithi197.stdout:Provides: virtualbox-guest-modules (= 6.1.16-dfsg-6~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.10) 2021-07-26T15:26:10.547 INFO:teuthology.orchestra.run.smithi197.stdout:Depends: linux-image-5.4.0-80-generic, linux-modules-extra-5.4.0-80-generic, linux-firmware, intel-microcode, amd64-microcode 2021-07-26T15:26:10.549 INFO:teuthology.orchestra.run.smithi197.stdout:Recommends: thermald 2021-07-26T15:26:10.549 INFO:teuthology.orchestra.run.smithi197.stdout:Description: Generic Linux kernel image 2021-07-26T15:26:10.549 INFO:teuthology.orchestra.run.smithi197.stdout: This package will always depend on the latest generic kernel image 2021-07-26T15:26:10.550 INFO:teuthology.orchestra.run.smithi197.stdout: available. 2021-07-26T15:26:10.551 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-66-generic Expected: 5.4.0-80-generic 2021-07-26T15:26:10.551 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2021-07-26T15:26:10.552 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-07-26T15:26:10.552 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-07-26T15:26:10.553 INFO:teuthology.task.kernel:Installing distro kernel on c1.mon.a... 2021-07-26T15:26:10.554 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi183.front.sepia.ceph.com, path=None, version=distro) 2021-07-26T15:26:10.555 DEBUG:teuthology.orchestra.run.smithi183:> sudo apt-get clean 2021-07-26T15:26:10.643 DEBUG:teuthology.orchestra.run.smithi183:> sudo apt-get update 2021-07-26T15:26:10.833 INFO:teuthology.orchestra.run.smithi183.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-07-26T15:26:10.945 INFO:teuthology.orchestra.run.smithi183.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-07-26T15:26:11.052 INFO:teuthology.orchestra.run.smithi183.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-07-26T15:26:11.167 INFO:teuthology.orchestra.run.smithi183.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-07-26T15:26:12.287 INFO:teuthology.orchestra.run.smithi183.stdout:Reading package lists... 2021-07-26T15:26:12.308 DEBUG:teuthology.orchestra.run.smithi183:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-07-26T15:26:12.374 INFO:teuthology.orchestra.run.smithi183.stdout:Reading package lists... 2021-07-26T15:26:12.516 INFO:teuthology.orchestra.run.smithi183.stdout:Building dependency tree... 2021-07-26T15:26:12.518 INFO:teuthology.orchestra.run.smithi183.stdout:Reading state information... 2021-07-26T15:26:12.586 INFO:teuthology.orchestra.run.smithi183.stderr:E: Unable to locate package linux-image-current-generic 2021-07-26T15:26:12.587 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-07-26T15:26:12.588 DEBUG:teuthology.orchestra.run.smithi183:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-07-26T15:26:12.650 INFO:teuthology.orchestra.run.smithi183.stdout:Reading package lists... 2021-07-26T15:26:12.807 INFO:teuthology.orchestra.run.smithi183.stdout:Building dependency tree... 2021-07-26T15:26:12.807 INFO:teuthology.orchestra.run.smithi183.stdout:Reading state information... 2021-07-26T15:26:12.961 INFO:teuthology.orchestra.run.smithi183.stdout:linux-image-generic is already the newest version (5.4.0.80.84). 2021-07-26T15:26:12.961 INFO:teuthology.orchestra.run.smithi183.stdout:0 upgraded, 0 newly installed, 0 to remove and 160 not upgraded. 2021-07-26T15:26:12.964 DEBUG:teuthology.orchestra.run.smithi183:> dpkg -s linux-image-generic 2021-07-26T15:26:12.986 INFO:teuthology.orchestra.run.smithi183.stdout:Package: linux-image-generic 2021-07-26T15:26:12.987 INFO:teuthology.orchestra.run.smithi183.stdout:Status: install ok installed 2021-07-26T15:26:12.987 INFO:teuthology.orchestra.run.smithi183.stdout:Priority: optional 2021-07-26T15:26:12.987 INFO:teuthology.orchestra.run.smithi183.stdout:Section: kernel 2021-07-26T15:26:12.988 INFO:teuthology.orchestra.run.smithi183.stdout:Installed-Size: 18 2021-07-26T15:26:12.988 INFO:teuthology.orchestra.run.smithi183.stdout:Maintainer: Ubuntu Kernel Team 2021-07-26T15:26:12.988 INFO:teuthology.orchestra.run.smithi183.stdout:Architecture: amd64 2021-07-26T15:26:12.988 INFO:teuthology.orchestra.run.smithi183.stdout:Source: linux-meta 2021-07-26T15:26:12.988 INFO:teuthology.orchestra.run.smithi183.stdout:Version: 5.4.0.80.84 2021-07-26T15:26:12.989 INFO:teuthology.orchestra.run.smithi183.stdout:Provides: virtualbox-guest-modules (= 6.1.16-dfsg-6~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.10) 2021-07-26T15:26:12.989 INFO:teuthology.orchestra.run.smithi183.stdout:Depends: linux-image-5.4.0-80-generic, linux-modules-extra-5.4.0-80-generic, linux-firmware, intel-microcode, amd64-microcode 2021-07-26T15:26:12.989 INFO:teuthology.orchestra.run.smithi183.stdout:Recommends: thermald 2021-07-26T15:26:12.989 INFO:teuthology.orchestra.run.smithi183.stdout:Description: Generic Linux kernel image 2021-07-26T15:26:12.990 INFO:teuthology.orchestra.run.smithi183.stdout: This package will always depend on the latest generic kernel image 2021-07-26T15:26:12.990 INFO:teuthology.orchestra.run.smithi183.stdout: available. 2021-07-26T15:26:12.990 DEBUG:teuthology.orchestra.run.smithi183:> mktemp 2021-07-26T15:26:13.040 INFO:teuthology.orchestra.run.smithi183.stdout:/tmp/tmp.ybIhDlDqI2 2021-07-26T15:26:13.041 DEBUG:teuthology.orchestra.run.smithi183:> sudo cp /boot/grub/grub.cfg /tmp/tmp.ybIhDlDqI2 2021-07-26T15:26:13.056 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 0666 /tmp/tmp.ybIhDlDqI2 2021-07-26T15:26:13.140 DEBUG:teuthology.orchestra.remote:smithi183:/tmp/tmp.ybIhDlDqI2 is 8KB 2021-07-26T15:26:13.156 DEBUG:teuthology.orchestra.run.smithi183:> rm -fr /tmp/tmp.ybIhDlDqI2 2021-07-26T15:26:13.163 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-07-26T15:26:13.217 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2021-07-26T15:26:13.218 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-07-26T15:26:13.219 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-07-26T15:26:13.251 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-80-generic 2021-07-26T15:26:13.251 DEBUG:teuthology.orchestra.run.smithi183:> sudo update-grub 2021-07-26T15:26:14.310 INFO:teuthology.orchestra.run.smithi183.stderr:Sourcing file `/etc/default/grub' 2021-07-26T15:26:14.312 INFO:teuthology.orchestra.run.smithi183.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-07-26T15:26:14.328 INFO:teuthology.orchestra.run.smithi183.stderr:Generating grub configuration file ... 2021-07-26T15:26:14.656 INFO:teuthology.orchestra.run.smithi183.stderr:Found linux image: /boot/vmlinuz-5.4.0-80-generic 2021-07-26T15:26:14.668 INFO:teuthology.orchestra.run.smithi183.stderr:Found initrd image: /boot/initrd.img-5.4.0-80-generic 2021-07-26T15:26:15.057 INFO:teuthology.orchestra.run.smithi183.stderr:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-07-26T15:26:15.069 INFO:teuthology.orchestra.run.smithi183.stderr:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-07-26T15:26:15.804 INFO:teuthology.orchestra.run.smithi183.stderr:done 2021-07-26T15:26:15.806 DEBUG:teuthology.orchestra.run.smithi183:> sudo shutdown -r now 2021-07-26T15:26:15.808 INFO:teuthology.task.kernel:Installing distro kernel on c2.mon.a... 2021-07-26T15:26:15.808 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi197.front.sepia.ceph.com, path=None, version=distro) 2021-07-26T15:26:15.809 DEBUG:teuthology.orchestra.run.smithi197:> sudo apt-get clean 2021-07-26T15:26:15.879 DEBUG:teuthology.orchestra.run.smithi197:> sudo apt-get update 2021-07-26T15:26:16.021 INFO:teuthology.orchestra.run.smithi197.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-07-26T15:26:16.175 INFO:teuthology.orchestra.run.smithi197.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-07-26T15:26:16.276 INFO:teuthology.orchestra.run.smithi197.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-07-26T15:26:16.378 INFO:teuthology.orchestra.run.smithi197.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-07-26T15:26:17.530 INFO:teuthology.orchestra.run.smithi197.stdout:Reading package lists... 2021-07-26T15:26:17.557 DEBUG:teuthology.orchestra.run.smithi197:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-07-26T15:26:17.624 INFO:teuthology.orchestra.run.smithi197.stdout:Reading package lists... 2021-07-26T15:26:17.782 INFO:teuthology.orchestra.run.smithi197.stdout:Building dependency tree... 2021-07-26T15:26:17.783 INFO:teuthology.orchestra.run.smithi197.stdout:Reading state information... 2021-07-26T15:26:17.862 INFO:teuthology.orchestra.run.smithi197.stderr:E: Unable to locate package linux-image-current-generic 2021-07-26T15:26:17.863 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-07-26T15:26:17.864 DEBUG:teuthology.orchestra.run.smithi197:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-07-26T15:26:17.935 INFO:teuthology.orchestra.run.smithi197.stdout:Reading package lists... 2021-07-26T15:26:18.093 INFO:teuthology.orchestra.run.smithi197.stdout:Building dependency tree... 2021-07-26T15:26:18.093 INFO:teuthology.orchestra.run.smithi197.stdout:Reading state information... 2021-07-26T15:26:18.247 INFO:teuthology.orchestra.run.smithi197.stdout:linux-image-generic is already the newest version (5.4.0.80.84). 2021-07-26T15:26:18.247 INFO:teuthology.orchestra.run.smithi197.stdout:0 upgraded, 0 newly installed, 0 to remove and 160 not upgraded. 2021-07-26T15:26:18.249 DEBUG:teuthology.orchestra.run.smithi197:> dpkg -s linux-image-generic 2021-07-26T15:26:18.268 INFO:teuthology.orchestra.run.smithi197.stdout:Package: linux-image-generic 2021-07-26T15:26:18.269 INFO:teuthology.orchestra.run.smithi197.stdout:Status: install ok installed 2021-07-26T15:26:18.269 INFO:teuthology.orchestra.run.smithi197.stdout:Priority: optional 2021-07-26T15:26:18.269 INFO:teuthology.orchestra.run.smithi197.stdout:Section: kernel 2021-07-26T15:26:18.269 INFO:teuthology.orchestra.run.smithi197.stdout:Installed-Size: 18 2021-07-26T15:26:18.270 INFO:teuthology.orchestra.run.smithi197.stdout:Maintainer: Ubuntu Kernel Team 2021-07-26T15:26:18.270 INFO:teuthology.orchestra.run.smithi197.stdout:Architecture: amd64 2021-07-26T15:26:18.270 INFO:teuthology.orchestra.run.smithi197.stdout:Source: linux-meta 2021-07-26T15:26:18.270 INFO:teuthology.orchestra.run.smithi197.stdout:Version: 5.4.0.80.84 2021-07-26T15:26:18.271 INFO:teuthology.orchestra.run.smithi197.stdout:Provides: virtualbox-guest-modules (= 6.1.16-dfsg-6~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.10) 2021-07-26T15:26:18.271 INFO:teuthology.orchestra.run.smithi197.stdout:Depends: linux-image-5.4.0-80-generic, linux-modules-extra-5.4.0-80-generic, linux-firmware, intel-microcode, amd64-microcode 2021-07-26T15:26:18.271 INFO:teuthology.orchestra.run.smithi197.stdout:Recommends: thermald 2021-07-26T15:26:18.271 INFO:teuthology.orchestra.run.smithi197.stdout:Description: Generic Linux kernel image 2021-07-26T15:26:18.272 INFO:teuthology.orchestra.run.smithi197.stdout: This package will always depend on the latest generic kernel image 2021-07-26T15:26:18.272 INFO:teuthology.orchestra.run.smithi197.stdout: available. 2021-07-26T15:26:18.272 DEBUG:teuthology.orchestra.run.smithi197:> mktemp 2021-07-26T15:26:18.321 INFO:teuthology.orchestra.run.smithi197.stdout:/tmp/tmp.8KOTnGpTua 2021-07-26T15:26:18.322 DEBUG:teuthology.orchestra.run.smithi197:> sudo cp /boot/grub/grub.cfg /tmp/tmp.8KOTnGpTua 2021-07-26T15:26:18.348 DEBUG:teuthology.orchestra.run.smithi197:> sudo chmod 0666 /tmp/tmp.8KOTnGpTua 2021-07-26T15:26:18.428 DEBUG:teuthology.orchestra.remote:smithi197:/tmp/tmp.8KOTnGpTua is 8KB 2021-07-26T15:26:18.446 DEBUG:teuthology.orchestra.run.smithi197:> rm -fr /tmp/tmp.8KOTnGpTua 2021-07-26T15:26:18.453 DEBUG:teuthology.orchestra.run.smithi197:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-07-26T15:26:18.510 DEBUG:teuthology.orchestra.run.smithi197:> set -ex 2021-07-26T15:26:18.511 DEBUG:teuthology.orchestra.run.smithi197:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-07-26T15:26:18.512 DEBUG:teuthology.orchestra.run.smithi197:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-07-26T15:26:18.560 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-80-generic 2021-07-26T15:26:18.560 DEBUG:teuthology.orchestra.run.smithi197:> sudo update-grub 2021-07-26T15:26:19.804 INFO:teuthology.orchestra.run.smithi197.stderr:Sourcing file `/etc/default/grub' 2021-07-26T15:26:19.806 INFO:teuthology.orchestra.run.smithi197.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-07-26T15:26:19.817 INFO:teuthology.orchestra.run.smithi197.stderr:Generating grub configuration file ... 2021-07-26T15:26:20.069 INFO:teuthology.orchestra.run.smithi197.stderr:Found linux image: /boot/vmlinuz-5.4.0-80-generic 2021-07-26T15:26:20.073 INFO:teuthology.orchestra.run.smithi197.stderr:Found initrd image: /boot/initrd.img-5.4.0-80-generic 2021-07-26T15:26:20.415 INFO:teuthology.orchestra.run.smithi197.stderr:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-07-26T15:26:20.426 INFO:teuthology.orchestra.run.smithi197.stderr:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-07-26T15:26:21.208 INFO:teuthology.orchestra.run.smithi197.stderr:done 2021-07-26T15:26:21.210 DEBUG:teuthology.orchestra.run.smithi197:> sudo shutdown -r now 2021-07-26T15:26:51.243 INFO:teuthology.misc:Re-opening connections... 2021-07-26T15:26:51.243 INFO:teuthology.misc:trying to connect to ubuntu@smithi183.front.sepia.ceph.com 2021-07-26T15:26:51.244 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-26T15:26:51.245 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-26T15:27:09.775 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.183 2021-07-26T15:27:09.776 INFO:teuthology.misc:trying to connect to ubuntu@smithi197.front.sepia.ceph.com 2021-07-26T15:27:09.776 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-26T15:27:09.777 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi197.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-26T15:28:09.835 DEBUG:teuthology.orchestra.remote:timed out 2021-07-26T15:28:09.837 DEBUG:teuthology.misc:waited 78.59353446960449 2021-07-26T15:28:10.838 INFO:teuthology.misc:trying to connect to ubuntu@smithi183.front.sepia.ceph.com 2021-07-26T15:28:10.840 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-26T15:28:10.841 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-26T15:28:13.899 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.183 2021-07-26T15:28:13.899 INFO:teuthology.misc:trying to connect to ubuntu@smithi197.front.sepia.ceph.com 2021-07-26T15:28:13.900 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-26T15:28:13.900 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi197.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-26T15:28:14.091 DEBUG:teuthology.orchestra.run.smithi197:> true 2021-07-26T15:28:14.630 DEBUG:teuthology.misc:waited 83.38638496398926 2021-07-26T15:28:15.631 INFO:teuthology.misc:trying to connect to ubuntu@smithi183.front.sepia.ceph.com 2021-07-26T15:28:15.632 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-26T15:28:15.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-26T15:28:16.970 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.183 2021-07-26T15:28:16.972 DEBUG:teuthology.misc:waited 85.72816371917725 2021-07-26T15:28:17.972 INFO:teuthology.misc:trying to connect to ubuntu@smithi183.front.sepia.ceph.com 2021-07-26T15:28:17.973 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-26T15:28:17.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-26T15:28:20.043 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.183 2021-07-26T15:28:20.044 DEBUG:teuthology.misc:waited 88.80049920082092 2021-07-26T15:28:21.045 INFO:teuthology.misc:trying to connect to ubuntu@smithi183.front.sepia.ceph.com 2021-07-26T15:28:21.046 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-26T15:28:21.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-26T15:28:23.114 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.183 2021-07-26T15:28:23.115 DEBUG:teuthology.misc:waited 91.8716778755188 2021-07-26T15:28:24.117 INFO:teuthology.misc:trying to connect to ubuntu@smithi183.front.sepia.ceph.com 2021-07-26T15:28:24.118 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-26T15:28:24.118 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-26T15:28:26.186 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.183 2021-07-26T15:28:26.187 DEBUG:teuthology.misc:waited 94.94370794296265 2021-07-26T15:28:27.188 INFO:teuthology.misc:trying to connect to ubuntu@smithi183.front.sepia.ceph.com 2021-07-26T15:28:27.189 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-26T15:28:27.189 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-26T15:28:29.263 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.183 2021-07-26T15:28:29.263 DEBUG:teuthology.misc:waited 98.0198540687561 2021-07-26T15:28:30.265 INFO:teuthology.misc:trying to connect to ubuntu@smithi183.front.sepia.ceph.com 2021-07-26T15:28:30.265 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-26T15:28:30.266 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-26T15:28:32.331 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.183 2021-07-26T15:28:32.331 DEBUG:teuthology.misc:waited 101.08808827400208 2021-07-26T15:28:33.333 INFO:teuthology.misc:trying to connect to ubuntu@smithi183.front.sepia.ceph.com 2021-07-26T15:28:33.333 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-26T15:28:33.334 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-26T15:28:35.408 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.183 2021-07-26T15:28:35.408 DEBUG:teuthology.misc:waited 104.16510057449341 2021-07-26T15:28:36.409 INFO:teuthology.misc:trying to connect to ubuntu@smithi183.front.sepia.ceph.com 2021-07-26T15:28:36.410 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-26T15:28:36.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-26T15:28:38.475 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.183 2021-07-26T15:28:38.475 DEBUG:teuthology.misc:waited 107.23177576065063 2021-07-26T15:28:39.476 INFO:teuthology.misc:trying to connect to ubuntu@smithi183.front.sepia.ceph.com 2021-07-26T15:28:39.476 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-26T15:28:39.477 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-26T15:28:41.547 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.183 2021-07-26T15:28:41.547 DEBUG:teuthology.misc:waited 110.30375099182129 2021-07-26T15:28:42.548 INFO:teuthology.misc:trying to connect to ubuntu@smithi183.front.sepia.ceph.com 2021-07-26T15:28:42.901 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-26T15:28:42.903 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-26T15:29:14.687 DEBUG:teuthology.orchestra.run.smithi183:> true 2021-07-26T15:29:15.477 DEBUG:teuthology.misc:waited 144.23409700393677 2021-07-26T15:29:16.478 INFO:teuthology.task.kernel:Checking client c1.mon.a for new kernel version... 2021-07-26T15:29:16.479 INFO:teuthology.task.kernel:Checking kernel version of c1.mon.a, want "5.4.0-80-generic"... 2021-07-26T15:29:16.479 DEBUG:teuthology.orchestra.run.smithi183:> uname -r 2021-07-26T15:29:16.487 INFO:teuthology.orchestra.run.smithi183.stdout:5.4.0-80-generic 2021-07-26T15:29:16.487 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-80-generic vs 5.4.0-80-generic 2021-07-26T15:29:16.487 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-07-26T15:29:16.488 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-07-26T15:29:16.488 INFO:teuthology.task.kernel:Checking client c2.mon.a for new kernel version... 2021-07-26T15:29:16.488 INFO:teuthology.task.kernel:Checking kernel version of c2.mon.a, want "5.4.0-80-generic"... 2021-07-26T15:29:16.489 DEBUG:teuthology.orchestra.run.smithi197:> uname -r 2021-07-26T15:29:16.496 INFO:teuthology.orchestra.run.smithi197.stdout:5.4.0-80-generic 2021-07-26T15:29:16.496 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-80-generic vs 5.4.0-80-generic 2021-07-26T15:29:16.497 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-07-26T15:29:16.497 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-07-26T15:29:17.498 INFO:teuthology.task.kernel:Enabling kdb on c1.mon.a... 2021-07-26T15:29:17.498 DEBUG:teuthology.orchestra.run.smithi183:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-07-26T15:29:17.580 INFO:teuthology.orchestra.run.smithi183.stdout:ttyS1 2021-07-26T15:29:17.604 INFO:teuthology.task.kernel:Enabling kdb on c2.mon.a... 2021-07-26T15:29:17.605 DEBUG:teuthology.orchestra.run.smithi197:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-07-26T15:29:17.698 INFO:teuthology.orchestra.run.smithi197.stdout:ttyS1 2021-07-26T15:29:17.727 INFO:teuthology.run_tasks:Running task internal.base... 2021-07-26T15:29:17.738 INFO:teuthology.task.internal:Creating test directory... 2021-07-26T15:29:17.739 DEBUG:teuthology.orchestra.run.smithi183:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-07-26T15:29:17.742 DEBUG:teuthology.orchestra.run.smithi197:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-07-26T15:29:17.758 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2021-07-26T15:29:17.782 INFO:teuthology.run_tasks:Running task internal.archive... 2021-07-26T15:29:17.816 INFO:teuthology.task.internal:Creating archive directory... 2021-07-26T15:29:17.816 DEBUG:teuthology.orchestra.run.smithi183:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-07-26T15:29:17.821 DEBUG:teuthology.orchestra.run.smithi197:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-07-26T15:29:17.841 INFO:teuthology.run_tasks:Running task internal.coredump... 2021-07-26T15:29:17.852 INFO:teuthology.task.internal:Enabling coredump saving... 2021-07-26T15:29:17.853 DEBUG:teuthology.orchestra.run.smithi183:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-07-26T15:29:17.880 DEBUG:teuthology.orchestra.run.smithi197:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-07-26T15:29:17.905 INFO:teuthology.orchestra.run.smithi183.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-07-26T15:29:17.915 INFO:teuthology.orchestra.run.smithi183.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-07-26T15:29:17.927 INFO:teuthology.orchestra.run.smithi197.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-07-26T15:29:17.939 INFO:teuthology.orchestra.run.smithi197.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-07-26T15:29:17.941 INFO:teuthology.run_tasks:Running task internal.sudo... 2021-07-26T15:29:17.952 INFO:teuthology.task.internal:Configuring sudo... 2021-07-26T15:29:17.952 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-07-26T15:29:17.955 DEBUG:teuthology.orchestra.run.smithi197:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-07-26T15:29:17.971 INFO:teuthology.run_tasks:Running task internal.syslog... 2021-07-26T15:29:17.984 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2021-07-26T15:29:17.985 DEBUG:teuthology.orchestra.run.smithi183:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-07-26T15:29:18.015 DEBUG:teuthology.orchestra.run.smithi197:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-07-26T15:29:18.022 DEBUG:teuthology.orchestra.run.smithi183:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-07-26T15:29:18.030 DEBUG:teuthology.orchestra.run.smithi183:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-07-26T15:29:18.036 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2021-07-26T15:29:18.036 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-07-26T15:29:18.101 DEBUG:teuthology.orchestra.run.smithi197:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-07-26T15:29:18.109 DEBUG:teuthology.orchestra.run.smithi197:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-07-26T15:29:18.159 DEBUG:teuthology.orchestra.run.smithi197:> set -ex 2021-07-26T15:29:18.159 DEBUG:teuthology.orchestra.run.smithi197:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-07-26T15:29:18.179 DEBUG:teuthology.orchestra.run.smithi183:> sudo service rsyslog restart 2021-07-26T15:29:18.181 DEBUG:teuthology.orchestra.run.smithi197:> sudo service rsyslog restart 2021-07-26T15:29:18.237 INFO:teuthology.run_tasks:Running task internal.timer... 2021-07-26T15:29:18.246 INFO:teuthology.task.internal:Starting timer... 2021-07-26T15:29:18.247 INFO:teuthology.run_tasks:Running task pcp... 2021-07-26T15:29:18.293 INFO:teuthology.run_tasks:Running task selinux... 2021-07-26T15:29:18.318 DEBUG:teuthology.task.selinux:Excluding smithi183: OS 'ubuntu' does not support SELinux 2021-07-26T15:29:18.318 DEBUG:teuthology.task.selinux:Excluding smithi197: OS 'ubuntu' does not support SELinux 2021-07-26T15:29:18.318 DEBUG:teuthology.task.selinux:Getting current SELinux state 2021-07-26T15:29:18.319 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2021-07-26T15:29:18.319 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2021-07-26T15:29:18.319 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2021-07-26T15:29:18.350 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated or references a specific commit; assuming it is current 2021-07-26T15:29:18.351 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to origin/master 2021-07-26T15:29:18.371 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2021-07-26T15:29:18.373 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi183.front.sepia.ceph.com,smithi197.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2021-07-26T15:29:18.730 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2021-07-26T15:29:19.556 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2021-07-26T15:29:22.460 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2021-07-26T15:29:22.483 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:29:22 +0000 (0:00:00.038) 0:00:00.038 *********** 2021-07-26T15:29:22.497 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:29:22 +0000 (0:00:00.013) 0:00:00.052 *********** 2021-07-26T15:29:24.700 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2021-07-26T15:29:24.702 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 20.04 on host smithi183.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. ok: [smithi183.front.sepia.ceph.com] 2021-07-26T15:29:24.711 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 20.04 on host smithi197.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. ok: [smithi197.front.sepia.ceph.com] 2021-07-26T15:29:24.772 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:29:24 +0000 (0:00:02.275) 0:00:02.327 *********** 2021-07-26T15:29:24.906 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:29:24 +0000 (0:00:00.133) 0:00:02.461 *********** 2021-07-26T15:29:25.144 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2021-07-26T15:29:25.146 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} ok: [smithi183.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-07-26T15:29:25.167 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:29:25 +0000 (0:00:00.261) 0:00:02.723 *********** 2021-07-26T15:29:25.190 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:29:25 +0000 (0:00:00.022) 0:00:02.745 *********** 2021-07-26T15:29:25.719 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2021-07-26T15:29:25.721 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-07-26T15:29:25.743 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:29:25 +0000 (0:00:00.552) 0:00:03.298 *********** 2021-07-26T15:29:25.750 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-07-26T15:29:25.777 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:29:25 +0000 (0:00:00.034) 0:00:03.332 *********** 2021-07-26T15:29:26.138 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2021-07-26T15:29:26.140 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.069092", "end": "2021-07-26 15:29:26.582121", "rc": 0, "start": "2021-07-26 15:29:26.513029", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2021-07-26T15:29:26.162 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:29:26 +0000 (0:00:00.385) 0:00:03.717 *********** 2021-07-26T15:29:26.170 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.088417", "end": "2021-07-26 15:29:26.231994", "rc": 0, "start": "2021-07-26 15:29:26.143577", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2021-07-26T15:29:26.196 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:29:26 +0000 (0:00:00.033) 0:00:03.751 *********** 2021-07-26T15:29:26.430 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** ok: [smithi197.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-07-26T15:29:26.457 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:29:26 +0000 (0:00:00.260) 0:00:04.012 *********** 2021-07-26T15:29:26.467 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-07-26T15:29:26.492 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:29:26 +0000 (0:00:00.034) 0:00:04.047 *********** 2021-07-26T15:29:27.374 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** changed: [smithi183.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1627313366.5473278-11315-237515966397334/source", "state": "file", "uid": 0} 2021-07-26T15:29:27.395 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:29:27 +0000 (0:00:00.903) 0:00:04.950 *********** 2021-07-26T15:29:27.403 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1627313366.4966052-11310-41923823666118/source", "state": "file", "uid": 0} 2021-07-26T15:29:27.428 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:29:27 +0000 (0:00:00.032) 0:00:04.983 *********** 2021-07-26T15:29:27.830 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2021-07-26T15:29:27.832 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2021-07-26T15:29:27.833 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi183.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail 2021-07-26T15:29:27.835 INFO:teuthology.task.ansible.out:.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@ 2021-07-26T15:29:27.837 INFO:teuthology.task.ansible.out:aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-07-26T15:29:27.918 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2021-07-26T15:29:27.920 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-07-26T15:29:27.933 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2021-07-26T15:29:27.935 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:29:27 +0000 (0:00:00.504) 0:00:05.488 *********** 2021-07-26T15:29:28.623 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] 2021-07-26T15:29:28.644 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] 2021-07-26T15:29:28.664 INFO:teuthology.task.ansible.out: TASK [set_fact] **************************************************************** Monday 26 July 2021 15:29:28 +0000 (0:00:00.730) 0:00:06.219 *********** 2021-07-26T15:29:28.692 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => {"ansible_facts": {"ran_from_cephlab_playbook": true}, "changed": false} 2021-07-26T15:29:28.703 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"ansible_facts": {"ran_from_cephlab_playbook": true}, "changed": false} 2021-07-26T15:29:28.709 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-07-26T15:29:28.881 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:29:28 +0000 (0:00:00.217) 0:00:06.436 *********** 2021-07-26T15:29:28.906 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:29:28 +0000 (0:00:00.024) 0:00:06.461 *********** 2021-07-26T15:29:29.719 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi183.front.sepia.ceph.com] 2021-07-26T15:29:29.752 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] 2021-07-26T15:29:29.783 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2021-07-26T15:29:29.784 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:29:29 +0000 (0:00:00.877) 0:00:07.338 *********** 2021-07-26T15:29:29.830 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:29:29 +0000 (0:00:00.046) 0:00:07.384 *********** 2021-07-26T15:29:30.241 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2021-07-26T15:29:30.243 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.212595", "end": "2021-07-26 15:29:30.213520", "rc": 0, "start": "2021-07-26 15:29:30.000925", "stderr": "", "stderr_lines": [], "stdout": "fa3530b6c8007ac148c609947f616c9ce81a7370", "stdout_lines": ["fa3530b6c8007ac148c609947f616c9ce81a7370"]} 2021-07-26T15:29:30.264 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:29:30 +0000 (0:00:00.435) 0:00:07.820 *********** 2021-07-26T15:29:30.271 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.187590", "end": "2021-07-26 15:29:30.241539", "rc": 0, "start": "2021-07-26 15:29:30.053949", "stderr": "", "stderr_lines": [], "stdout": "fa3530b6c8007ac148c609947f616c9ce81a7370", "stdout_lines": ["fa3530b6c8007ac148c609947f616c9ce81a7370"]} 2021-07-26T15:29:30.298 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:29:30 +0000 (0:00:00.033) 0:00:07.853 *********** 2021-07-26T15:29:30.408 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2021-07-26T15:29:30.410 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.015780", "end": "2021-07-26 15:29:30.863031", "failed_when_result": false, "rc": 0, "start": "2021-07-26 15:29:30.847251", "stderr": "", "stderr_lines": [], "stdout": "df8946f08e870e2d2565b79099289ca48bd825f3", "stdout_lines": ["df8946f08e870e2d2565b79099289ca48bd825f3"]} 2021-07-26T15:29:30.433 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:29:30 +0000 (0:00:00.135) 0:00:07.989 *********** 2021-07-26T15:29:30.451 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.016053", "end": "2021-07-26 15:29:30.527732", "failed_when_result": false, "rc": 0, "start": "2021-07-26 15:29:30.511679", "stderr": "", "stderr_lines": [], "stdout": "df8946f08e870e2d2565b79099289ca48bd825f3", "stdout_lines": ["df8946f08e870e2d2565b79099289ca48bd825f3"]} 2021-07-26T15:29:30.479 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:29:30 +0000 (0:00:00.045) 0:00:08.034 *********** 2021-07-26T15:29:30.507 INFO:teuthology.task.ansible.out: TASK [Determine if we can skip users and pubkeys updates] ********************** 2021-07-26T15:29:30.509 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:29:30.532 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:29:30 +0000 (0:00:00.053) 0:00:08.087 *********** 2021-07-26T15:29:30.550 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:29:30.574 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:29:30 +0000 (0:00:00.042) 0:00:08.129 *********** 2021-07-26T15:29:30.601 INFO:teuthology.task.ansible.out: TASK [Merge extra_admin_users into managed_admin_users] ************************ 2021-07-26T15:29:30.603 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:29:30.625 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:29:30 +0000 (0:00:00.051) 0:00:08.181 *********** 2021-07-26T15:29:30.642 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:29:30.670 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:29:30 +0000 (0:00:00.043) 0:00:08.225 *********** 2021-07-26T15:29:30.698 INFO:teuthology.task.ansible.out: TASK [Remove managed_admin_users from managed_users] *************************** skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:29:30.724 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:29:30 +0000 (0:00:00.054) 0:00:08.279 *********** 2021-07-26T15:29:30.741 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:29:30.765 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:29:30 +0000 (0:00:00.041) 0:00:08.321 *********** 2021-07-26T15:29:30.793 INFO:teuthology.task.ansible.out: TASK [Filter the managed_users list] ******************************************* skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:29:30.820 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:29:30 +0000 (0:00:00.054) 0:00:08.375 *********** 2021-07-26T15:29:30.848 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:29:30.874 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:29:30 +0000 (0:00:00.053) 0:00:08.429 *********** 2021-07-26T15:29:30.903 INFO:teuthology.task.ansible.out: TASK [Filter the managed_admin_users list] ************************************* 2021-07-26T15:29:30.905 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:29:30.927 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:29:30 +0000 (0:00:00.053) 0:00:08.483 *********** 2021-07-26T15:29:30.946 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:29:30.976 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:29:30 +0000 (0:00:00.048) 0:00:08.532 *********** 2021-07-26T15:29:31.121 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2021-07-26T15:29:31.123 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-07-26T15:29:31.145 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:29:31 +0000 (0:00:00.168) 0:00:08.700 *********** 2021-07-26T15:29:31.163 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-07-26T15:29:31.191 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:29:31 +0000 (0:00:00.045) 0:00:08.746 *********** 2021-07-26T15:29:31.386 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-07-26T15:29:31.388 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-07-26T15:29:31.430 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-07-26T15:29:31.526 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-07-26T15:29:31.580 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-07-26T15:29:31.665 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-07-26T15:29:31.719 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-07-26T15:29:31.814 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-07-26T15:29:31.868 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-07-26T15:29:31.952 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-07-26T15:29:32.005 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-07-26T15:29:32.100 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-07-26T15:29:32.154 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-07-26T15:29:32.238 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-07-26T15:29:32.292 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-07-26T15:29:32.387 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-07-26T15:29:32.430 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-07-26T15:29:32.525 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-07-26T15:29:32.577 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-07-26T15:29:32.673 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-07-26T15:29:32.716 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-07-26T15:29:32.811 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-07-26T15:29:32.867 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-07-26T15:29:32.963 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-07-26T15:29:33.006 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-07-26T15:29:33.101 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-07-26T15:29:33.154 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-07-26T15:29:33.251 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-07-26T15:29:33.294 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-07-26T15:29:33.387 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-07-26T15:29:33.442 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-07-26T15:29:33.561 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-07-26T15:29:33.756 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-07-26T15:29:33.785 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-07-26T15:29:33.829 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-07-26T15:29:33.968 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2021-07-26T15:29:34.012 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2021-07-26T15:29:34.128 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-07-26T15:29:34.175 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-07-26T15:29:34.282 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-07-26T15:29:34.356 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-07-26T15:29:34.432 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2021-07-26T15:29:34.507 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2021-07-26T15:29:34.583 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-07-26T15:29:34.663 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-07-26T15:29:34.739 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-07-26T15:29:34.825 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-07-26T15:29:34.889 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-07-26T15:29:34.972 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-07-26T15:29:35.025 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-07-26T15:29:35.111 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-07-26T15:29:35.175 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-07-26T15:29:35.269 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-07-26T15:29:35.323 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-07-26T15:29:35.408 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-07-26T15:29:35.472 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-07-26T15:29:35.555 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-07-26T15:29:35.608 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-07-26T15:29:35.693 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-07-26T15:29:35.759 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-07-26T15:29:35.834 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-07-26T15:29:35.905 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-07-26T15:29:35.992 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-07-26T15:29:36.055 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-07-26T15:29:36.129 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-07-26T15:29:36.192 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1133} 2021-07-26T15:29:36.276 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1133} 2021-07-26T15:29:36.339 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-07-26T15:29:36.424 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-07-26T15:29:36.477 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-07-26T15:29:36.561 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-07-26T15:29:36.624 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-07-26T15:29:36.710 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-07-26T15:29:36.772 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-07-26T15:29:36.857 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-07-26T15:29:36.921 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-07-26T15:29:36.995 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-07-26T15:29:37.069 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-07-26T15:29:37.143 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-07-26T15:29:37.217 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-07-26T15:29:37.291 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-07-26T15:29:37.354 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-07-26T15:29:37.439 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-07-26T15:29:37.503 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-07-26T15:29:37.587 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-07-26T15:29:37.650 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-07-26T15:29:37.724 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-07-26T15:29:37.796 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-07-26T15:29:37.870 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-07-26T15:29:37.943 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-07-26T15:29:38.017 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-07-26T15:29:38.101 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-07-26T15:29:38.153 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-07-26T15:29:38.237 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-07-26T15:29:38.291 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-07-26T15:29:38.385 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-07-26T15:29:38.437 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-07-26T15:29:38.521 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-07-26T15:29:38.574 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-07-26T15:29:38.669 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-07-26T15:29:38.711 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-07-26T15:29:38.805 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-07-26T15:29:38.858 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-07-26T15:29:38.953 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-07-26T15:29:39.006 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-07-26T15:29:39.100 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-07-26T15:29:39.143 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-07-26T15:29:39.238 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-07-26T15:29:39.290 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-07-26T15:29:39.377 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-07-26T15:29:39.430 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-07-26T15:29:39.524 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-07-26T15:29:39.568 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-07-26T15:29:39.673 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-07-26T15:29:39.715 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-07-26T15:29:39.809 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-07-26T15:29:39.863 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-07-26T15:29:39.952 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-07-26T15:29:40.005 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-07-26T15:29:40.100 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-07-26T15:29:40.153 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-07-26T15:29:40.239 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-07-26T15:29:40.303 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-07-26T15:29:40.388 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-07-26T15:29:40.451 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-07-26T15:29:40.535 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-07-26T15:29:40.591 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-07-26T15:29:40.677 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-07-26T15:29:40.741 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-07-26T15:29:40.814 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-07-26T15:29:40.888 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-07-26T15:29:40.961 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-07-26T15:29:41.024 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-07-26T15:29:41.110 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-07-26T15:29:41.175 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-07-26T15:29:41.249 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-07-26T15:29:41.312 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-07-26T15:29:41.396 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-07-26T15:29:41.460 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-07-26T15:29:41.534 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-07-26T15:29:41.599 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-07-26T15:29:41.682 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-07-26T15:29:41.736 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-07-26T15:29:41.820 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-07-26T15:29:41.883 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-07-26T15:29:41.970 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-07-26T15:29:42.022 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-07-26T15:29:42.107 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-07-26T15:29:42.171 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-07-26T15:29:42.255 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-07-26T15:29:42.308 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-07-26T15:29:42.395 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-07-26T15:29:42.450 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-07-26T15:29:42.557 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-07-26T15:29:42.590 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-07-26T15:29:42.695 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-07-26T15:29:42.738 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-07-26T15:29:42.846 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-07-26T15:29:42.879 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-07-26T15:29:42.984 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-07-26T15:29:43.027 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-07-26T15:29:43.131 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-07-26T15:29:43.174 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-07-26T15:29:43.268 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-07-26T15:29:43.322 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-07-26T15:29:43.406 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-07-26T15:29:43.469 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-07-26T15:29:43.552 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1184} 2021-07-26T15:29:43.616 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1184} 2021-07-26T15:29:43.689 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-07-26T15:29:43.763 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-07-26T15:29:43.836 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-07-26T15:29:43.910 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-07-26T15:29:43.974 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-07-26T15:29:44.060 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-07-26T15:29:44.123 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-07-26T15:29:44.198 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-07-26T15:29:44.273 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-07-26T15:29:44.349 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-07-26T15:29:44.422 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-07-26T15:29:44.486 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-07-26T15:29:44.560 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-07-26T15:29:44.622 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-07-26T15:29:44.707 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-07-26T15:29:44.771 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-07-26T15:29:44.855 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-07-26T15:29:44.928 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-07-26T15:29:45.002 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-07-26T15:29:45.075 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-07-26T15:29:45.141 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-07-26T15:29:45.226 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-07-26T15:29:45.280 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-07-26T15:29:45.374 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-07-26T15:29:45.427 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-07-26T15:29:45.512 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-07-26T15:29:45.565 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-07-26T15:29:45.650 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-07-26T15:29:45.713 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-07-26T15:29:45.787 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-07-26T15:29:45.851 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-07-26T15:29:45.935 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-07-26T15:29:45.999 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-07-26T15:29:46.086 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-07-26T15:29:46.140 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-07-26T15:29:46.234 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-07-26T15:29:46.288 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-07-26T15:29:46.371 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-07-26T15:29:46.424 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-07-26T15:29:46.507 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-07-26T15:29:46.572 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-07-26T15:29:46.655 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-07-26T15:29:46.718 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-07-26T15:29:46.792 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-07-26T15:29:46.858 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-07-26T15:29:46.939 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-07-26T15:29:46.993 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-07-26T15:29:47.078 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-07-26T15:29:47.142 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-07-26T15:29:47.227 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-07-26T15:29:47.280 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-07-26T15:29:47.375 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-07-26T15:29:47.428 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-07-26T15:29:47.513 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-07-26T15:29:47.576 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-07-26T15:29:47.660 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-07-26T15:29:47.713 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-07-26T15:29:47.809 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-07-26T15:29:47.862 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-07-26T15:29:47.957 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-07-26T15:29:48.000 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-07-26T15:29:48.096 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-07-26T15:29:48.149 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-07-26T15:29:48.244 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-07-26T15:29:48.297 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-07-26T15:29:48.382 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-07-26T15:29:48.435 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-07-26T15:29:48.529 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-07-26T15:29:48.571 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-07-26T15:29:48.676 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-07-26T15:29:48.718 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-07-26T15:29:48.812 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-07-26T15:29:48.866 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-07-26T15:29:48.961 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-07-26T15:29:49.003 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-07-26T15:29:49.108 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-07-26T15:29:49.150 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-07-26T15:29:49.244 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-07-26T15:29:49.287 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-07-26T15:29:49.391 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-07-26T15:29:49.434 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-07-26T15:29:49.538 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-07-26T15:29:49.581 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-07-26T15:29:49.675 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-07-26T15:29:49.731 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-07-26T15:29:49.826 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-07-26T15:29:49.879 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-07-26T15:29:49.964 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-07-26T15:29:50.033 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-07-26T15:29:50.108 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-07-26T15:29:50.172 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-07-26T15:29:50.257 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-07-26T15:29:50.320 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-07-26T15:29:50.403 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-07-26T15:29:50.466 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/hmunjulu", "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "move_home": false, "name": "hmunjulu", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-07-26T15:29:50.540 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/hmunjulu", "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "move_home": false, "name": "hmunjulu", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-07-26T15:29:50.615 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-07-26T15:29:50.689 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-07-26T15:29:50.751 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-07-26T15:29:50.825 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-07-26T15:29:50.900 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-07-26T15:29:50.974 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-07-26T15:29:51.049 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-07-26T15:29:51.113 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-07-26T15:29:51.187 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-07-26T15:29:51.260 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-07-26T15:29:51.334 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-07-26T15:29:51.408 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-07-26T15:29:51.948 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "name": "dachary", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2021-07-26T15:29:51.980 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "name": "dachary", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2021-07-26T15:29:52.485 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/amctagga", "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "name": "amctagga", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2021-07-26T15:29:52.496 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/amctagga", "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "name": "amctagga", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2021-07-26T15:29:52.994 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/kevinz", "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "name": "kevinz", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2021-07-26T15:29:53.047 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/kevinz", "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "name": "kevinz", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2021-07-26T15:29:53.523 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10106, "groups": "sudo", "home": "/home/liu-chunmei", "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "name": "liu-chunmei", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10105} 2021-07-26T15:29:53.607 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10106, "groups": "sudo", "home": "/home/liu-chunmei", "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "name": "liu-chunmei", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10105} 2021-07-26T15:29:54.087 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10107, "groups": "sudo", "home": "/home/cyx1231st", "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "name": "cyx1231st", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10106} 2021-07-26T15:29:54.109 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10107, "groups": "sudo", "home": "/home/cyx1231st", "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "name": "cyx1231st", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10106} 2021-07-26T15:29:54.565 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10108, "groups": "sudo", "home": "/home/sunnagar", "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "name": "sunnagar", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10107} 2021-07-26T15:29:54.607 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10108, "groups": "sudo", "home": "/home/sunnagar", "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "name": "sunnagar", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10107} 2021-07-26T15:29:55.110 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10109, "groups": "sudo", "home": "/home/lflores", "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "name": "lflores", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10108} 2021-07-26T15:29:55.131 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10109, "groups": "sudo", "home": "/home/lflores", "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "name": "lflores", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10108} 2021-07-26T15:29:55.650 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10110, "groups": "sudo", "home": "/home/jsawaya", "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "name": "jsawaya", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10109} 2021-07-26T15:29:55.651 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10110, "groups": "sudo", "home": "/home/jsawaya", "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "name": "jsawaya", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10109} 2021-07-26T15:29:56.123 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10111, "groups": "sudo", "home": "/home/markw8973240", "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "name": "markw8973240", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10110} 2021-07-26T15:29:56.155 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10111, "groups": "sudo", "home": "/home/markw8973240", "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "name": "markw8973240", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10110} 2021-07-26T15:29:56.674 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10112, "groups": "sudo", "home": "/home/luisrico", "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "name": "luisrico", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10111} 2021-07-26T15:29:56.676 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10112, "groups": "sudo", "home": "/home/luisrico", "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "name": "luisrico", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10111} 2021-07-26T15:29:57.222 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10113, "groups": "sudo", "home": "/home/matan", "item": {"name": "matan", "ovpn": "matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa"}, "name": "matan", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10112} 2021-07-26T15:29:57.244 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10113, "groups": "sudo", "home": "/home/matan", "item": {"name": "matan", "ovpn": "matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa"}, "name": "matan", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10112} 2021-07-26T15:29:57.709 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10114, "groups": "sudo", "home": "/home/ozeneva", "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "name": "ozeneva", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10113} 2021-07-26T15:29:57.731 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10114, "groups": "sudo", "home": "/home/ozeneva", "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "name": "ozeneva", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10113} 2021-07-26T15:29:58.283 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10115, "groups": "sudo", "home": "/home/sudhanaruna", "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "name": "sudhanaruna", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10114} 2021-07-26T15:29:58.295 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10115, "groups": "sudo", "home": "/home/sudhanaruna", "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "name": "sudhanaruna", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10114} 2021-07-26T15:29:58.743 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10116, "groups": "sudo", "home": "/home/zl31wang", "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "name": "zl31wang", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10115} 2021-07-26T15:29:58.837 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10116, "groups": "sudo", "home": "/home/zl31wang", "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "name": "zl31wang", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10115} 2021-07-26T15:29:59.282 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10117, "groups": "sudo", "home": "/home/mayagilad", "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "name": "mayagilad", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10116} 2021-07-26T15:29:59.311 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10117, "groups": "sudo", "home": "/home/mayagilad", "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "name": "mayagilad", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10116} 2021-07-26T15:29:59.502 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:29:59 +0000 (0:00:28.311) 0:00:37.057 *********** 2021-07-26T15:29:59.523 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:29:59 +0000 (0:00:00.020) 0:00:37.078 *********** 2021-07-26T15:29:59.565 INFO:teuthology.task.ansible.out: TASK [Create all users without sudo access.] *********************************** 2021-07-26T15:29:59.589 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:29:59 +0000 (0:00:00.066) 0:00:37.144 *********** 2021-07-26T15:29:59.768 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:29:59 +0000 (0:00:00.178) 0:00:37.323 *********** 2021-07-26T15:29:59.829 INFO:teuthology.task.ansible.out: TASK [Merge managed_users and managed_admin users] ***************************** 2021-07-26T15:29:59.832 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora 2021-07-26T15:29:59.833 INFO:teuthology.task.ansible.out:rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265 2021-07-26T15:29:59.835 INFO:teuthology.task.ansible.out:c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop K 2021-07-26T15:29:59.837 INFO:teuthology.task.ansible.out:D0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9 2021-07-26T15:29:59.839 INFO:teuthology.task.ansible.out:df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9 2021-07-26T15:29:59.841 INFO:teuthology.task.ansible.out:b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", " 2021-07-26T15:29:59.842 INFO:teuthology.task.ansible.out:ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn" 2021-07-26T15:29:59.843 INFO:teuthology.task.ansible.out:: "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 2021-07-26T15:29:59.844 INFO:teuthology.task.ansible.out:f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": 2021-07-26T15:29:59.846 INFO:teuthology.task.ansible.out:"alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon 2021-07-26T15:29:59.848 INFO:teuthology.task.ansible.out:", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"nam 2021-07-26T15:29:59.849 INFO:teuthology.task.ansible.out:e": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449 2021-07-26T15:29:59.851 INFO:teuthology.task.ansible.out:ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn 2021-07-26T15:29:59.852 INFO:teuthology.task.ansible.out:": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev 2021-07-26T15:29:59.853 INFO:teuthology.task.ansible.out: JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185 2021-07-26T15:29:59.854 INFO:teuthology.task.ansible.out:052887b82ba5c343a42eb271747a"}, {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, {"name": "matan", "ovpn": "matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa"}, {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}]}, "changed": false} 2021-07-26T15:29:59.885 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:29:59 +0000 (0:00:00.117) 0:00:37.440 *********** 2021-07-26T15:29:59.982 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora 2021-07-26T15:29:59.983 INFO:teuthology.task.ansible.out:rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265 2021-07-26T15:29:59.984 INFO:teuthology.task.ansible.out:c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop K 2021-07-26T15:29:59.986 INFO:teuthology.task.ansible.out:D0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9 2021-07-26T15:29:59.988 INFO:teuthology.task.ansible.out:df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9 2021-07-26T15:29:59.989 INFO:teuthology.task.ansible.out:b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", " 2021-07-26T15:29:59.991 INFO:teuthology.task.ansible.out:ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 2021-07-26T15:29:59.992 INFO:teuthology.task.ansible.out:f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": 2021-07-26T15:29:59.994 INFO:teuthology.task.ansible.out:"alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon 2021-07-26T15:29:59.996 INFO:teuthology.task.ansible.out:", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"nam 2021-07-26T15:29:59.997 INFO:teuthology.task.ansible.out:e": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449 2021-07-26T15:29:59.999 INFO:teuthology.task.ansible.out:ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn 2021-07-26T15:30:00.000 INFO:teuthology.task.ansible.out:": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev 2021-07-26T15:30:00.001 INFO:teuthology.task.ansible.out: JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185 2021-07-26T15:30:00.002 INFO:teuthology.task.ansible.out:052887b82ba5c343a42eb271747a"}, {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, {"name": "matan", "ovpn": "matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa"}, {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}]}, "changed": false} 2021-07-26T15:30:00.030 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:00 +0000 (0:00:00.145) 0:00:37.586 *********** 2021-07-26T15:30:00.915 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2021-07-26T15:30:00.916 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => {"after": "fa3530b6c8007ac148c609947f616c9ce81a7370", "attempts": 1, "before": "fa3530b6c8007ac148c609947f616c9ce81a7370", "changed": false, "remote_url_changed": false} 2021-07-26T15:30:00.938 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:00 +0000 (0:00:00.907) 0:00:38.493 *********** 2021-07-26T15:30:00.977 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"after": "fa3530b6c8007ac148c609947f616c9ce81a7370", "attempts": 1, "before": "fa3530b6c8007ac148c609947f616c9ce81a7370", "changed": false, "remote_url_changed": false} 2021-07-26T15:30:01.002 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:00 +0000 (0:00:00.064) 0:00:38.557 *********** 2021-07-26T15:30:01.302 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-07-26T15:30:01.304 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-07-26T15:30:01.376 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-07-26T15:30:01.439 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-07-26T15:30:01.503 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-07-26T15:30:01.576 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-07-26T15:30:01.649 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-07-26T15:30:01.712 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2021-07-26T15:30:01.714 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-07-26T15:30:01.786 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2021-07-26T15:30:01.788 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-07-26T15:30:01.848 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-07-26T15:30:01.912 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-07-26T15:30:01.975 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2021-07-26T15:30:01.977 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-07-26T15:30:02.048 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2021-07-26T15:30:02.049 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-07-26T15:30:02.121 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-07-26T15:30:02.184 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-07-26T15:30:02.247 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-07-26T15:30:02.321 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-07-26T15:30:02.384 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-07-26T15:30:02.395 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:02.458 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-07-26T15:30:02.459 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:02.533 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2021-07-26T15:30:02.535 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-07-26T15:30:02.586 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2021-07-26T15:30:02.587 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-07-26T15:30:02.659 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2021-07-26T15:30:02.661 INFO:teuthology.task.ansible.out:son", "validate_certs": true} 2021-07-26T15:30:02.670 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:02.671 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:02.723 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2021-07-26T15:30:02.725 INFO:teuthology.task.ansible.out:son", "validate_certs": true} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:02.735 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:02.798 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-07-26T15:30:02.861 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-07-26T15:30:02.944 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2021-07-26T15:30:02.946 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-07-26T15:30:02.997 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2021-07-26T15:30:02.999 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-07-26T15:30:03.081 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-07-26T15:30:03.144 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-07-26T15:30:03.217 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": 2021-07-26T15:30:03.219 INFO:teuthology.task.ansible.out:null, "state": "present", "user": "davidz", "validate_certs": true} 2021-07-26T15:30:03.269 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": 2021-07-26T15:30:03.271 INFO:teuthology.task.ansible.out:null, "state": "present", "user": "davidz", "validate_certs": true} 2021-07-26T15:30:03.344 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-07-26T15:30:03.407 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-07-26T15:30:03.480 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-07-26T15:30:03.534 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-07-26T15:30:03.607 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2021-07-26T15:30:03.672 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2021-07-26T15:30:03.745 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2021-07-26T15:30:03.747 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-07-26T15:30:03.809 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2021-07-26T15:30:03.811 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-07-26T15:30:03.883 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2021-07-26T15:30:03.885 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-07-26T15:30:03.936 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2021-07-26T15:30:03.938 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-07-26T15:30:04.022 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-07-26T15:30:04.074 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-07-26T15:30:04.147 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-07-26T15:30:04.200 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-07-26T15:30:04.284 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7 2021-07-26T15:30:04.286 INFO:teuthology.task.ansible.out:gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrSX8nDL2WaHe0b/rjE3TZhj5VwbrG6nn/hyWmm2dWcUqotSp973yD2G4tQL9UygeSkDGmjb6whrz2mcAFJ5P4oLtIcCLyZC550dcpwV3BtP/cMAIGE6xeEARKiP8KlVGFNDRg9/l1aAd08Bepe+rJyAYD7IxOOBfgKJMKbeOWnT40RTfwiD5CXNwjzQuhzZDEbm+8zjTChFM4P1EkfR3c+0X3MYpA1AsRQY0ElvFtcn6G0yPKR+obGdIs+ydGupKh1+peGWLemHMA5e62Bs4/Lwtyebyp7AOguC3ZBJ3TZWL4Vn1q6z21cQe6AuowjPrneZWC4ifFB6OUQJqM+R00pHBcajcvsfpYOblZvTJHM726Ek1vahOYfcbEMpqWlVYo+WPRUilzl5cI3ReyAcwphebqKPbhmzCuyJw3lWBKIVDhWjEFzGkxV/iFU5rIXFm/Z0JGNFFxmY1U4GlA4lFXtL7OvEdMsiZo1x0cNmFWLu0k9fQBtiQI19ZBiA7FPKc= yehuda@crestview", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-07-26T15:30:04.337 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7 2021-07-26T15:30:04.339 INFO:teuthology.task.ansible.out:gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrSX8nDL2WaHe0b/rjE3TZhj5VwbrG6nn/hyWmm2dWcUqotSp973yD2G4tQL9UygeSkDGmjb6whrz2mcAFJ5P4oLtIcCLyZC550dcpwV3BtP/cMAIGE6xeEARKiP8KlVGFNDRg9/l1aAd08Bepe+rJyAYD7IxOOBfgKJMKbeOWnT40RTfwiD5CXNwjzQuhzZDEbm+8zjTChFM4P1EkfR3c+0X3MYpA1AsRQY0ElvFtcn6G0yPKR+obGdIs+ydGupKh1+peGWLemHMA5e62Bs4/Lwtyebyp7AOguC3ZBJ3TZWL4Vn1q6z21cQe6AuowjPrneZWC4ifFB6OUQJqM+R00pHBcajcvsfpYOblZvTJHM726Ek1vahOYfcbEMpqWlVYo+WPRUilzl5cI3ReyAcwphebqKPbhmzCuyJw3lWBKIVDhWjEFzGkxV/iFU5rIXFm/Z0JGNFFxmY1U4GlA4lFXtL7OvEdMsiZo1x0cNmFWLu0k9fQBtiQI19ZBiA7FPKc= yehuda@crestview", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-07-26T15:30:04.429 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-07-26T15:30:04.600 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-07-26T15:30:04.611 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-07-26T15:30:04.634 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-07-26T15:30:04.782 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-07-26T15:30:04.794 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-07-26T15:30:04.921 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-07-26T15:30:04.933 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-07-26T15:30:05.060 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-07-26T15:30:05.093 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-07-26T15:30:05.221 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2021-07-26T15:30:05.224 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-07-26T15:30:05.254 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2021-07-26T15:30:05.256 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-07-26T15:30:05.355 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2021-07-26T15:30:05.401 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2021-07-26T15:30:05.485 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-07-26T15:30:05.539 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-07-26T15:30:05.622 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-07-26T15:30:05.664 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-07-26T15:30:05.749 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-07-26T15:30:05.795 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-07-26T15:30:05.892 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-07-26T15:30:05.928 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-07-26T15:30:06.022 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-07-26T15:30:06.074 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-07-26T15:30:06.160 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-07-26T15:30:06.204 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-07-26T15:30:06.287 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-07-26T15:30:06.340 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-07-26T15:30:06.417 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2021-07-26T15:30:06.419 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-07-26T15:30:06.470 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2021-07-26T15:30:06.472 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-07-26T15:30:06.554 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2021-07-26T15:30:06.556 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-07-26T15:30:06.607 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2021-07-26T15:30:06.609 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-07-26T15:30:06.680 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-07-26T15:30:06.733 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-07-26T15:30:06.827 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-07-26T15:30:06.880 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-07-26T15:30:06.954 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-07-26T15:30:07.008 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-07-26T15:30:07.084 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtV 2021-07-26T15:30:07.086 INFO:teuthology.task.ansible.out:TFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-07-26T15:30:07.148 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtV 2021-07-26T15:30:07.150 INFO:teuthology.task.ansible.out:TFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-07-26T15:30:07.223 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2021-07-26T15:30:07.226 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2021-07-26T15:30:07.227 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-07-26T15:30:07.297 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2021-07-26T15:30:07.300 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2021-07-26T15:30:07.301 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-07-26T15:30:07.350 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-07-26T15:30:07.424 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-07-26T15:30:07.488 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-07-26T15:30:07.563 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-07-26T15:30:07.637 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-07-26T15:30:07.732 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-07-26T15:30:07.764 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-07-26T15:30:07.868 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-07-26T15:30:07.900 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-07-26T15:30:07.995 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-07-26T15:30:08.026 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2021-07-26T15:30:08.028 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-07-26T15:30:08.132 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2021-07-26T15:30:08.134 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-07-26T15:30:08.156 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-07-26T15:30:08.273 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-07-26T15:30:08.306 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-07-26T15:30:08.515 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-07-26T15:30:08.517 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2021-07-26T15:30:08.519 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2021-07-26T15:30:08.548 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2021-07-26T15:30:08.550 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2021-07-26T15:30:08.570 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-07-26T15:30:08.685 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-07-26T15:30:08.696 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-07-26T15:30:08.823 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-07-26T15:30:08.835 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2021-07-26T15:30:08.837 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-07-26T15:30:08.950 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2021-07-26T15:30:08.953 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-07-26T15:30:08.971 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-07-26T15:30:09.076 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-07-26T15:30:09.098 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-07-26T15:30:09.215 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-07-26T15:30:09.257 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-07-26T15:30:09.341 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-07-26T15:30:09.394 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-07-26T15:30:09.469 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-07-26T15:30:09.532 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-07-26T15:30:09.605 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-07-26T15:30:09.658 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-07-26T15:30:09.744 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-07-26T15:30:09.786 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-07-26T15:30:09.871 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-07-26T15:30:09.925 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-07-26T15:30:10.000 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-07-26T15:30:10.063 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-07-26T15:30:10.136 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-07-26T15:30:10.203 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-07-26T15:30:10.265 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-07-26T15:30:10.331 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-07-26T15:30:10.397 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-07-26T15:30:10.461 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-07-26T15:30:10.535 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-07-26T15:30:10.588 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-07-26T15:30:10.662 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-07-26T15:30:10.717 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-07-26T15:30:10.790 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-07-26T15:30:10.867 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-07-26T15:30:10.931 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-07-26T15:30:10.995 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-07-26T15:30:11.059 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-07-26T15:30:11.132 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-07-26T15:30:11.195 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-07-26T15:30:11.262 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-07-26T15:30:11.315 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-07-26T15:30:11.391 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-07-26T15:30:11.455 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-07-26T15:30:11.519 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-07-26T15:30:11.582 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-07-26T15:30:11.656 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2021-07-26T15:30:11.658 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-07-26T15:30:11.720 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2021-07-26T15:30:11.721 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-07-26T15:30:11.783 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-07-26T15:30:11.847 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-07-26T15:30:11.914 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-07-26T15:30:11.977 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-07-26T15:30:12.057 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-07-26T15:30:12.118 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-07-26T15:30:12.182 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2021-07-26T15:30:12.240 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2021-07-26T15:30:12.314 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.locald 2021-07-26T15:30:12.316 INFO:teuthology.task.ansible.out:omain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2021-07-26T15:30:12.378 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.locald 2021-07-26T15:30:12.380 INFO:teuthology.task.ansible.out:omain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2021-07-26T15:30:12.452 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2021-07-26T15:30:12.454 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-07-26T15:30:12.505 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2021-07-26T15:30:12.507 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-07-26T15:30:12.580 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-07-26T15:30:12.653 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-07-26T15:30:12.720 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-07-26T15:30:12.791 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-07-26T15:30:12.844 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-07-26T15:30:12.940 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-07-26T15:30:12.983 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-07-26T15:30:13.068 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-07-26T15:30:13.121 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-07-26T15:30:13.205 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-07-26T15:30:13.258 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-07-26T15:30:13.356 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-07-26T15:30:13.395 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-07-26T15:30:13.489 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-07-26T15:30:13.532 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2021-07-26T15:30:13.534 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-07-26T15:30:13.610 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2021-07-26T15:30:13.613 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-07-26T15:30:13.669 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-07-26T15:30:13.740 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-07-26T15:30:13.785 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-07-26T15:30:13.871 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-07-26T15:30:13.926 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-07-26T15:30:14.012 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-07-26T15:30:14.056 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-07-26T15:30:14.150 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-07-26T15:30:14.198 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-07-26T15:30:14.282 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-07-26T15:30:14.331 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-07-26T15:30:14.416 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-07-26T15:30:14.459 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/ 2021-07-26T15:30:14.460 INFO:teuthology.task.ansible.out:yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-07-26T15:30:14.553 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/ 2021-07-26T15:30:14.555 INFO:teuthology.task.ansible.out:yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-07-26T15:30:14.596 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-07-26T15:30:14.681 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-07-26T15:30:14.724 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-07-26T15:30:14.813 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-07-26T15:30:14.866 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-07-26T15:30:14.950 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-07-26T15:30:14.996 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-07-26T15:30:15.091 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-07-26T15:30:15.123 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-07-26T15:30:15.232 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-07-26T15:30:15.254 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-07-26T15:30:15.361 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-07-26T15:30:15.382 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-07-26T15:30:15.489 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-07-26T15:30:15.523 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-07-26T15:30:15.630 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-07-26T15:30:15.654 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-07-26T15:30:15.770 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-07-26T15:30:15.792 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-07-26T15:30:15.915 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-07-26T15:30:15.923 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-07-26T15:30:16.062 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-07-26T15:30:16.073 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-07-26T15:30:16.184 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-07-26T15:30:16.210 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-07-26T15:30:16.318 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-07-26T15:30:16.340 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-07-26T15:30:16.440 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-07-26T15:30:16.472 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-07-26T15:30:16.578 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-07-26T15:30:16.610 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-07-26T15:30:16.705 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-07-26T15:30:16.748 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-07-26T15:30:16.844 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-07-26T15:30:16.886 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-07-26T15:30:16.972 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2021-07-26T15:30:16.974 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-07-26T15:30:17.015 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-07-26T15:30:17.115 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-07-26T15:30:17.157 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2021-07-26T15:30:17.160 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-07-26T15:30:17.242 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-07-26T15:30:17.295 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-07-26T15:30:17.370 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-07-26T15:30:17.423 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-07-26T15:30:17.520 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-07-26T15:30:17.562 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-07-26T15:30:17.647 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-07-26T15:30:17.701 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-07-26T15:30:17.817 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-07-26T15:30:17.828 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-07-26T15:30:17.956 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-07-26T15:30:17.979 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-07-26T15:30:18.085 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-07-26T15:30:18.118 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-07-26T15:30:18.226 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-07-26T15:30:18.258 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-07-26T15:30:18.352 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-07-26T15:30:18.386 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-07-26T15:30:18.492 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-07-26T15:30:18.525 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-07-26T15:30:18.620 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQKiUAlB8dxudAY60M7jnIJvs9yb2pNaT+BVv1Vk1kMs0XjPjcw9cyT3DtQ1xGLF367phRi/cfQbXOYbHG+uyBzQ4EEnBFvziktWRx4mfeWYxKjkjbfkVfpKPsxztqCbwm6+NYzMxGK2cExN7jUHnghHAjfA0IUpVVg9peBD3kUveLwS+UxuJAnuj+G4480LS6GDyLrhFEXU7uOIIlW4S9oLnU6vJL6GAzwyLE4ijTA8Ek03SJ01Ey/gpU9AqnQNp9u12l/7sJely6sI9pAuIzmS8Ht324hexxSWN5sFjXgLvLfFK83ziDBdrFBr0WXnWsFdRpHs2CwSq1JTkByqbN hmunjulu@hmunjulu.remote.csb", "key_options": null, "keyfile": "/home/hmunjulu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hmunjulu", "validate_certs": true} 2021-07-26T15:30:18.654 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-07-26T15:30:18.757 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-07-26T15:30:18.790 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQKiUAlB8dxudAY60M7jnIJvs9yb2pNaT+BVv1Vk1kMs0XjPjcw9cyT3DtQ1xGLF367phRi/cfQbXOYbHG+uyBzQ4EEnBFvziktWRx4mfeWYxKjkjbfkVfpKPsxztqCbwm6+NYzMxGK2cExN7jUHnghHAjfA0IUpVVg9peBD3kUveLwS+UxuJAnuj+G4480LS6GDyLrhFEXU7uOIIlW4S9oLnU6vJL6GAzwyLE4ijTA8Ek03SJ01Ey/gpU9AqnQNp9u12l/7sJely6sI9pAuIzmS8Ht324hexxSWN5sFjXgLvLfFK83ziDBdrFBr0WXnWsFdRpHs2CwSq1JTkByqbN hmunjulu@hmunjulu.remote.csb", "key_options": null, "keyfile": "/home/hmunjulu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hmunjulu", "validate_certs": true} 2021-07-26T15:30:18.895 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-07-26T15:30:18.917 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-07-26T15:30:19.022 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-07-26T15:30:19.065 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-07-26T15:30:19.158 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJOefD/VJfS15LRyuVDLluKv93Zgocsl8BhiDMimvBNbrGWc795v2+eevWuwaL/SlL44SnsNZ9Mz8FVn9YuFoQiHLg7cHZNLg9EJh5SMXzZzwLZHnF02MdI2CU6U++9nmh8FtBrdBWKzZ7o+01wOw+52dYOxvP7IJ7C/vjwOLgfigEN8Nd1PrxALVNIQz7fsiet0n3odk9PJfoqTu3IloXm9qbQiPFyfMA6b8a20RdLZCJDGGG5rd6gtsyeFHoAPZEz8FEUlNkow7NM7ZhdxOz/fWXyMZ27KmY8WSAgflbxysMzexyifkGzypiE3NQ10hdPGBgoYsHrAN4Qmte1/Z4aI5nxrNzLy/uNc+L/Bp/0XkLj9zfoiFFOReXvlz/laAV6LpbHyacr+iCwv9rlI7echXmvC6mSJXfBPuyR1uromUXpYRhEkn5uiOsCIQCuYpx2jeil7JV+LJlF62lLSndOv4g12Gq2TEZ4Bhsr2902kftPkLFenyfDTh3A2qGGNM= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-07-26T15:30:19.191 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-07-26T15:30:19.285 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", " 2021-07-26T15:30:19.287 INFO:teuthology.task.ansible.out:key_options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-07-26T15:30:19.327 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJOefD/VJfS15LRyuVDLluKv93Zgocsl8BhiDMimvBNbrGWc795v2+eevWuwaL/SlL44SnsNZ9Mz8FVn9YuFoQiHLg7cHZNLg9EJh5SMXzZzwLZHnF02MdI2CU6U++9nmh8FtBrdBWKzZ7o+01wOw+52dYOxvP7IJ7C/vjwOLgfigEN8Nd1PrxALVNIQz7fsiet0n3odk9PJfoqTu3IloXm9qbQiPFyfMA6b8a20RdLZCJDGGG5rd6gtsyeFHoAPZEz8FEUlNkow7NM7ZhdxOz/fWXyMZ27KmY8WSAgflbxysMzexyifkGzypiE3NQ10hdPGBgoYsHrAN4Qmte1/Z4aI5nxrNzLy/uNc+L/Bp/0XkLj9zfoiFFOReXvlz/laAV6LpbHyacr+iCwv9rlI7echXmvC6mSJXfBPuyR1uromUXpYRhEkn5uiOsCIQCuYpx2jeil7JV+LJlF62lLSndOv4g12Gq2TEZ4Bhsr2902kftPkLFenyfDTh3A2qGGNM= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-07-26T15:30:19.433 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr6H7hmtGCUrO3GppgMHwbmA4XT/Vipz/uLG/N8h6ZxtaLQKpCefRpdKcFlOdDwxkTmT5q9vmXQ8nl95lTGq+eeMxl4ho104ZD9e9AIYmgYqFy7/qNP8gkqduIPlypLL9m5rElTcGd7zqfMqgljMvAmnXLtZNJlIuFtszVU5WPI1QCwfQ3t5aHF6j66bpVoN9uWItVGB1LApQz9TtViWsQ9Hl8X4YauJToO+TkuSX+H/OGH7ZC6CPOzNZb3b3vF/jLMnTzXl86PJs1se4DjKkRGLVCVbr2WhLwQeZ8TEn3Hg1Gn5X8zNM5cTo6U8SnXBAe9ZYbuyfvghrNLdlZpmN+8l0/l5zC3z+N+sEzklXwHw4MQLF+KSloVFd9NN/kyenufTZAyp8VxllZ9TgdC+CPORIWyzmu1elOtYo7LNuE6CIh/Zm9B54SO6hVHhVoOCqe/dIyjeHJA0WKIZblK1XZEvWuu0E2T3jhxfe1GICyTukeB8WoBQH9DZ1yzMPt59E= nia@redhat.com", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-07-26T15:30:19.476 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", " 2021-07-26T15:30:19.478 INFO:teuthology.task.ansible.out:key_options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-07-26T15:30:19.572 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-07-26T15:30:19.607 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr6H7hmtGCUrO3GppgMHwbmA4XT/Vipz/uLG/N8h6ZxtaLQKpCefRpdKcFlOdDwxkTmT5q9vmXQ8nl95lTGq+eeMxl4ho104ZD9e9AIYmgYqFy7/qNP8gkqduIPlypLL9m5rElTcGd7zqfMqgljMvAmnXLtZNJlIuFtszVU5WPI1QCwfQ3t5aHF6j66bpVoN9uWItVGB1LApQz9TtViWsQ9Hl8X4YauJToO+TkuSX+H/OGH7ZC6CPOzNZb3b3vF/jLMnTzXl86PJs1se4DjKkRGLVCVbr2WhLwQeZ8TEn3Hg1Gn5X8zNM5cTo6U8SnXBAe9ZYbuyfvghrNLdlZpmN+8l0/l5zC3z+N+sEzklXwHw4MQLF+KSloVFd9NN/kyenufTZAyp8VxllZ9TgdC+CPORIWyzmu1elOtYo7LNuE6CIh/Zm9B54SO6hVHhVoOCqe/dIyjeHJA0WKIZblK1XZEvWuu0E2T3jhxfe1GICyTukeB8WoBQH9DZ1yzMPt59E= nia@redhat.com", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-07-26T15:30:19.713 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDwVh9KqjV0b+65aBxQV66IUwNo3D5zTbN8U6Kh6eE4QtaIVe5Mmvi2SBbGMSWofE0zIIw2JmsI5LzdOoCyZl/3gNDPHQd6D9o0xRHQv94giZ2a5K+mW79foAxsuppTjV/Fbg8EZ/19W91+BqMWotlMR66ka0RPT/6U8V5mzXoydSminViO/B6q7ZYzIIgGZqaTsSxCMvz5BAzzeEaGfSlGxw5MOye9sF/tDppuRKG4rMUZULEWGuxgXAtabtXCduocAArqAY3BRJEgj7JetPdPNjipGrULyYQmT7GeknvP/waC0sPm5o8t7taJca7Vu9qKKMKPAqiK4KhlrW/yVBFliT2CjAdVuYvGj87LCcEn6NMeF+4ONwDz++YwjrAWQT2zHUJPvLnYOZPiD1LUm3F34cEHD1y4Uf+oeiYgriUMauskfFn+ShbTmWWooFRFyNobzweg9aMBZSkA+kFFifqOV1FwHTOYg342NumRGB8svK0vvTUID7AU1Ev8YXYqCEGbb0UHth/1pEbAF103enLTtPZ6qKua74rE0qJ89OF9dZXv4JY9+8Juyps7bi2XEyHNm1nHZOY5tqdY0eKFmSGJMoWBDzGgdMjmXlWp4jnY2fC619nZqxMrCQpeT70CqnBhtBemUuu6jHYUbbrPjnXIkH3FZ7/qvZt0jF0IMP9FGw== amctagga@redhat.com", "key_options": null, "keyfile": "/home/amctagga/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amctagga", "validate_certs": true} 2021-07-26T15:30:19.757 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-07-26T15:30:19.843 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtiHTDuQk8EDH5R+JfDMucI4ZpOzKN5SLD+j35QLLySgGXholoDxtqjHnmRjM1rpj5SIaXjHBZdJi7iax+1MRywHYBi5BfTtzYPgA+NH8mt+XkcdkEuFPcYxGh6fMQDQWb2g9Euze/6qi0W9mbYXvvb1/Q3bhVCXg1UgKD42BndWEpbMYFfzJLZWPtOD/lg81pwUmf/4BpPFv52sy87lQVfkkvcUliLObR4S0TI5hPLYxBS+RXmHYKgvPMB2QJ9wum62lJ+YM1MxPygS0OWbIB6UQGXmvxRXA4osXkxJ8ksPPCupOgFNiiYro91cQh3mmi6iHc9kMz5R1aNGGOfDdlnLx9DRSIiNcacjXEVNFaoM0x441f4GeU2ZR8/7uq2dfk7QjPlh1eJGxG9pzRiQ8JCDF1car0eYwXdMTsQoQqpIi5imqcELdcqGGp9FhzFElgUwpf15JYlkouVhS6hq4LDjhLNk7dDT8fmCEnHOPcbxaTgN7J3idnJK6zeIniuuk= root@iZj6ce071s2zz3reioxn93Z", "key_options": null, "keyfile": "/home/kevinz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kevinz", "validate_certs": true} 2021-07-26T15:30:19.898 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDwVh9KqjV0b+65aBxQV66IUwNo3D5zTbN8U6Kh6eE4QtaIVe5Mmvi2SBbGMSWofE0zIIw2JmsI5LzdOoCyZl/3gNDPHQd6D9o0xRHQv94giZ2a5K+mW79foAxsuppTjV/Fbg8EZ/19W91+BqMWotlMR66ka0RPT/6U8V5mzXoydSminViO/B6q7ZYzIIgGZqaTsSxCMvz5BAzzeEaGfSlGxw5MOye9sF/tDppuRKG4rMUZULEWGuxgXAtabtXCduocAArqAY3BRJEgj7JetPdPNjipGrULyYQmT7GeknvP/waC0sPm5o8t7taJca7Vu9qKKMKPAqiK4KhlrW/yVBFliT2CjAdVuYvGj87LCcEn6NMeF+4ONwDz++YwjrAWQT2zHUJPvLnYOZPiD1LUm3F34cEHD1y4Uf+oeiYgriUMauskfFn+ShbTmWWooFRFyNobzweg9aMBZSkA+kFFifqOV1FwHTOYg342NumRGB8svK0vvTUID7AU1Ev8YXYqCEGbb0UHth/1pEbAF103enLTtPZ6qKua74rE0qJ89OF9dZXv4JY9+8Juyps7bi2XEyHNm1nHZOY5tqdY0eKFmSGJMoWBDzGgdMjmXlWp4jnY2fC619nZqxMrCQpeT70CqnBhtBemUuu6jHYUbbrPjnXIkH3FZ7/qvZt0jF0IMP9FGw== amctagga@redhat.com", "key_options": null, "keyfile": "/home/amctagga/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amctagga", "validate_certs": true} 2021-07-26T15:30:19.983 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1YAaxAvlRgu72huAggHpoDKSgtF/b00ACfUX4Wk5NyLFbYI3PAQapHNcNL4mIsH8pc6YkdjcJ5N/F12aEupJGQ0Q06OS324xapnaBoUy1hQl9IvhtPqTLEwR0X5xLIAhNBLIEJDNVg13MKwr0u5YVUXdrQRu7Kj9RXAPBahNZFo/Ed+cnR3LICQWliHeHFrk/DU2DUHol3a5wAPxrowAG0AxAecP6/7rASMmitvLQwdQcfIJAhWYgfyXzudg+gOmAEgv3O3U4QOikgmkm/EabUXLJnlTj6yuhtuuctdJr73UT3wLGAGmphLKCkug27kb1nTNoDa+PW/+grP63zhU1 chunmei@otccldstore05", "key_options": null, "keyfile": "/home/liu-chunmei/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liu-chunmei", "validate_certs": true} 2021-07-26T15:30:20.036 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtiHTDuQk8EDH5R+JfDMucI4ZpOzKN5SLD+j35QLLySgGXholoDxtqjHnmRjM1rpj5SIaXjHBZdJi7iax+1MRywHYBi5BfTtzYPgA+NH8mt+XkcdkEuFPcYxGh6fMQDQWb2g9Euze/6qi0W9mbYXvvb1/Q3bhVCXg1UgKD42BndWEpbMYFfzJLZWPtOD/lg81pwUmf/4BpPFv52sy87lQVfkkvcUliLObR4S0TI5hPLYxBS+RXmHYKgvPMB2QJ9wum62lJ+YM1MxPygS0OWbIB6UQGXmvxRXA4osXkxJ8ksPPCupOgFNiiYro91cQh3mmi6iHc9kMz5R1aNGGOfDdlnLx9DRSIiNcacjXEVNFaoM0x441f4GeU2ZR8/7uq2dfk7QjPlh1eJGxG9pzRiQ8JCDF1car0eYwXdMTsQoQqpIi5imqcELdcqGGp9FhzFElgUwpf15JYlkouVhS6hq4LDjhLNk7dDT8fmCEnHOPcbxaTgN7J3idnJK6zeIniuuk= root@iZj6ce071s2zz3reioxn93Z", "key_options": null, "keyfile": "/home/kevinz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kevinz", "validate_certs": true} 2021-07-26T15:30:20.115 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLbPdDb+XHOD2fo8g3RacATj0cG07uELwUvqQP35y+JmhNRSb/ttaysFLA5ss0y77TiXx22saP3ECEm5SnuPg5IERkPQmXiw84ATTNfLnzx2G5H223SLaTQiGfSgniBCJHVPCJfNahJiurlZoOAlwDz6SKXTUiivVrFJ22iTBDCQUO6HFQKjE7aM3RAo5mZXKVlTXzM6WOd8vlzk3HMzV0/91JR6H86Lt9MEzXT4dOzqmtxd8gS6U+vA+50zOIspdK+orTRJ0PO2Fn8c1RSYM8g7uqQtpDcOEHderW8TRsqBbDxpyslK6hRX5urUNBX506XE6JNoViLNvCofgseCGj yingxin@yingxin-server", "key_options": null, "keyfile": "/home/cyx1231st/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cyx1231st", "validate_certs": true} 2021-07-26T15:30:20.169 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1YAaxAvlRgu72huAggHpoDKSgtF/b00ACfUX4Wk5NyLFbYI3PAQapHNcNL4mIsH8pc6YkdjcJ5N/F12aEupJGQ0Q06OS324xapnaBoUy1hQl9IvhtPqTLEwR0X5xLIAhNBLIEJDNVg13MKwr0u5YVUXdrQRu7Kj9RXAPBahNZFo/Ed+cnR3LICQWliHeHFrk/DU2DUHol3a5wAPxrowAG0AxAecP6/7rASMmitvLQwdQcfIJAhWYgfyXzudg+gOmAEgv3O3U4QOikgmkm/EabUXLJnlTj6yuhtuuctdJr73UT3wLGAGmphLKCkug27kb1nTNoDa+PW/+grP63zhU1 chunmei@otccldstore05", "key_options": null, "keyfile": "/home/liu-chunmei/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liu-chunmei", "validate_certs": true} 2021-07-26T15:30:20.254 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdqw+8an6CHqsagFqXfuzQi1zCFHCh0e9pDtYz+ylA7L+7vnJLjTR7km0bb4Z6VTUh7h0/nUfF6faPzD2KGmTKvS+mTpeOUaN/H8O8j8qqh90f8z4T8F8L3DwqQbPf/R0izXmTgz0FZObFHmj+G8a+D4ndxF80EPzKkML/G0Hg2GEVdYzazSY4imSY2f56ul6qByBknhFshaTo2DUDcdbDDokF6lO6WgXhY0MJrT24CUSMyZmyi+3hF7vowW2dfbJ+SuDft4XmPDnIxRhDWWvi12jZb8Le7SWYzUlu7fAGbWe63VJqNh992myI61aZshApDD24+1xqIoo+Z/XkQD3l sunnagar@localhost.localdomain", "key_options": null, "keyfile": "/home/sunnagar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunnagar", "validate_certs": true} 2021-07-26T15:30:20.299 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLbPdDb+XHOD2fo8g3RacATj0cG07uELwUvqQP35y+JmhNRSb/ttaysFLA5ss0y77TiXx22saP3ECEm5SnuPg5IERkPQmXiw84ATTNfLnzx2G5H223SLaTQiGfSgniBCJHVPCJfNahJiurlZoOAlwDz6SKXTUiivVrFJ22iTBDCQUO6HFQKjE7aM3RAo5mZXKVlTXzM6WOd8vlzk3HMzV0/91JR6H86Lt9MEzXT4dOzqmtxd8gS6U+vA+50zOIspdK+orTRJ0PO2Fn8c1RSYM8g7uqQtpDcOEHderW8TRsqBbDxpyslK6hRX5urUNBX506XE6JNoViLNvCofgseCGj yingxin@yingxin-server", "key_options": null, "keyfile": "/home/cyx1231st/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cyx1231st", "validate_certs": true} 2021-07-26T15:30:20.407 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTlsh9TFwLCeeD2RR+56VhRZ0hp9CHj72U3Z1gbMpxpcg6PYEDzb+0qPVQp1/cIhcwwy0sm13yFl/A5i0iCRpyqB2MbyaXjj0HgkNinxLBFkPSiW2C83lfAyAhG/gLk+FcmWE4+xVrE29aoSM0JtcNtp+q83UGdnFcvhFe0pgJbt5vITo3ZMJND/UZrzeewyK8Vy4Rvpfy8aHYi2Eq+7WQrRHwUwxn0CwsxldnUfmZtu58d+Rtt78LRF0mvcScNlC7q5D+8htmYwkWkK639w5IB3xPv+Z5cV49Psi24Q+9BIr9Zo9/OnnCTauAi5ivDlh+kk/iBksAE8rQpMhvfuSFnNoq2O87aPQvNQHdRCcOa7FVIDcuocu6AB8UP4cGcJreT4+BW5Zbk6vQeJZhmj9yExpRj9MuONy5793nKuAMPn9lOjuXRfK7A5Tb3OOhpEJK1/MjtdZz4mNmFFfFIZ24hgTZO0pOiMwDf/tQ6BG7H8NS9g3QmXPyZajUocw6Szs= lflores@redhat.com", "key_options": null, "keyfile": "/home/lflores/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lflores", "validate_certs": true} 2021-07-26T15:30:20.444 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdqw+8an6CHqsagFqXfuzQi1zCFHCh0e9pDtYz+ylA7L+7vnJLjTR7km0bb4Z6VTUh7h0/nUfF6faPzD2KGmTKvS+mTpeOUaN/H8O8j8qqh90f8z4T8F8L3DwqQbPf/R0izXmTgz0FZObFHmj+G8a+D4ndxF80EPzKkML/G0Hg2GEVdYzazSY4imSY2f56ul6qByBknhFshaTo2DUDcdbDDokF6lO6WgXhY0MJrT24CUSMyZmyi+3hF7vowW2dfbJ+SuDft4XmPDnIxRhDWWvi12jZb8Le7SWYzUlu7fAGbWe63VJqNh992myI61aZshApDD24+1xqIoo+Z/XkQD3l sunnagar@localhost.localdomain", "key_options": null, "keyfile": "/home/sunnagar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunnagar", "validate_certs": true} 2021-07-26T15:30:20.542 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGq2g8OFN5msjIn5CNB2BRss9eIyJRk3r+7RQcnBOQid jsawaya@redhat.com", "key_options": null, "keyfile": "/home/jsawaya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsawaya", "validate_certs": true} 2021-07-26T15:30:20.584 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTlsh9TFwLCeeD2RR+56VhRZ0hp9CHj72U3Z1gbMpxpcg6PYEDzb+0qPVQp1/cIhcwwy0sm13yFl/A5i0iCRpyqB2MbyaXjj0HgkNinxLBFkPSiW2C83lfAyAhG/gLk+FcmWE4+xVrE29aoSM0JtcNtp+q83UGdnFcvhFe0pgJbt5vITo3ZMJND/UZrzeewyK8Vy4Rvpfy8aHYi2Eq+7WQrRHwUwxn0CwsxldnUfmZtu58d+Rtt78LRF0mvcScNlC7q5D+8htmYwkWkK639w5IB3xPv+Z5cV49Psi24Q+9BIr9Zo9/OnnCTauAi5ivDlh+kk/iBksAE8rQpMhvfuSFnNoq2O87aPQvNQHdRCcOa7FVIDcuocu6AB8UP4cGcJreT4+BW5Zbk6vQeJZhmj9yExpRj9MuONy5793nKuAMPn9lOjuXRfK7A5Tb3OOhpEJK1/MjtdZz4mNmFFfFIZ24hgTZO0pOiMwDf/tQ6BG7H8NS9g3QmXPyZajUocw6Szs= lflores@redhat.com", "key_options": null, "keyfile": "/home/lflores/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lflores", "validate_certs": true} 2021-07-26T15:30:20.671 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNIdsy+yA0QjwkvjzTiH4lKB+txlh4oGkgC0r1l9swmFvD+MuzNNkD+oB/YscT51tJXsP5/wZDZMuk60xds4Os2ejoIBvzdGBgZ1G2B33etHPmzgTFE7ZegBkMlvWYmrJ9YS+iaMvXn0MMtqfE4zq0kemVAA4NBfFZMhHPJMKCg7Gj31MR0S0b7dcPx7Jnpg4A45oHr0qnufeqZYQaHGgo+LO2xdoV4V2EswWr7YG+b1wI6DzFZBbNsGyQd+cE1BzQ8NmETPNNpDPk5dCyBS7U+4ZTf/WbWk3+Cn+Ky47iWfxcscupQRkCjmTYI/uCMhnrpGU0zEHkbFwLTS6wqDtDmVHm++xof3xSsGJ2cE/vZySZGHqdxqVXfT8gt17h35rME8eX3TU392rjfK6kjEUD3UgwJJp4NFzQIEXi2HTmDYx/Vi9nuId3V1NrDz98QLPUd1ijiy1DuzI0BJPE/DTDmsb7hNXNIcAV8VRc1243W3eaee/Pdg/wmwfkrgjTU3s= shuaiwang@Shuais-MacBook-Pro.local", "key_options": null, "keyfile": "/home/markw8973240/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "markw8973240", "validate_certs": true} 2021-07-26T15:30:20.740 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGq2g8OFN5msjIn5CNB2BRss9eIyJRk3r+7RQcnBOQid jsawaya@redhat.com", "key_options": null, "keyfile": "/home/jsawaya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsawaya", "validate_certs": true} 2021-07-26T15:30:20.829 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+ZvZuogU+WfyGj4BR2xYllNoQqAoxQ6AM0IYddBV2pL1xgTM/SopuAxDRP0q2stpozMtjVjlvuiIgr/caqyTuOgYtYCvB09ppefqdnCDrJJBCOKpjUEnCpAKcBMMuz9V32Zqt5FgpIi0Mu7Gp/QCvB97imxEkoUunpdX/8Ri/xz0nJO+QqoJX5wOn91jG49XnkMCLzx+MuafhT90WFO9CV1sIVREZS+X2C7ACQuhx9Qwk7R4BXt2f3M4dA0K2nLwaAnVW50M1y6Gs50Wl+ojDR1itySOxv8YpwyRlRTOzQTyVMnG0Qsaxxwp+hy4b/vQW3NIUvHYdTyvqALTQdGHT lricomor@lricomor-mac", "key_options": null, "keyfile": "/home/luisrico/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "luisrico", "validate_certs": true} 2021-07-26T15:30:20.881 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNIdsy+yA0QjwkvjzTiH4lKB+txlh4oGkgC0r1l9swmFvD+MuzNNkD+oB/YscT51tJXsP5/wZDZMuk60xds4Os2ejoIBvzdGBgZ1G2B33etHPmzgTFE7ZegBkMlvWYmrJ9YS+iaMvXn0MMtqfE4zq0kemVAA4NBfFZMhHPJMKCg7Gj31MR0S0b7dcPx7Jnpg4A45oHr0qnufeqZYQaHGgo+LO2xdoV4V2EswWr7YG+b1wI6DzFZBbNsGyQd+cE1BzQ8NmETPNNpDPk5dCyBS7U+4ZTf/WbWk3+Cn+Ky47iWfxcscupQRkCjmTYI/uCMhnrpGU0zEHkbFwLTS6wqDtDmVHm++xof3xSsGJ2cE/vZySZGHqdxqVXfT8gt17h35rME8eX3TU392rjfK6kjEUD3UgwJJp4NFzQIEXi2HTmDYx/Vi9nuId3V1NrDz98QLPUd1ijiy1DuzI0BJPE/DTDmsb7hNXNIcAV8VRc1243W3eaee/Pdg/wmwfkrgjTU3s= shuaiwang@Shuais-MacBook-Pro.local", "key_options": null, "keyfile": "/home/markw8973240/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "markw8973240", "validate_certs": true} 2021-07-26T15:30:20.996 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "matan", "ovpn": "matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICYMwYvykHtnVhhJwcKaiRh9oMpJkqvEA7OAbHPYOv6W matan.brz@gmail.com", "key_options": null, "keyfile": "/home/matan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "matan", "validate_certs": true} 2021-07-26T15:30:21.007 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+ZvZuogU+WfyGj4BR2xYllNoQqAoxQ6AM0IYddBV2pL1xgTM/SopuAxDRP0q2stpozMtjVjlvuiIgr/caqyTuOgYtYCvB09ppefqdnCDrJJBCOKpjUEnCpAKcBMMuz9V32Zqt5FgpIi0Mu7Gp/QCvB97imxEkoUunpdX/8Ri/xz0nJO+QqoJX5wOn91jG49XnkMCLzx+MuafhT90WFO9CV1sIVREZS+X2C7ACQuhx9Qwk7R4BXt2f3M4dA0K2nLwaAnVW50M1y6Gs50Wl+ojDR1itySOxv8YpwyRlRTOzQTyVMnG0Qsaxxwp+hy4b/vQW3NIUvHYdTyvqALTQdGHT lricomor@lricomor-mac", "key_options": null, "keyfile": "/home/luisrico/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "luisrico", "validate_certs": true} 2021-07-26T15:30:21.123 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkFTEUxQkQ1cplOLOf86Teu4qTYGkMqWtjIwzsU/AcimjFolSI5fJ3B72PH7bhQKkSnOlTjiOos2LrD5i/XgxkJD6icVWwHO11lczsq/8K5x0ZMJbJaiT3QphBB4yItoge2Y4/7g4o/78Ne+U7eZ1L5fgeO1fExtIaEXK1lS8pVlpZQXyproTIzp1WLHoaXb38Mxc5jAtuvEKfEycdX3c8k/9ti2qBCZnmjPH05WOxkqCRyNBT+bSJZyFMYt9RDUuycn3BYVSXTAzPW0qwgvKY5vij+qiFoxij7nKNMH7w6C0arolCcJxhiMyEF3UbTuOxgVONWyqFk/vScGGSYj9ytQYjv0L1cFyOVhlpbu+tnptulfQ3faMpjROE/eYxTIoY7OPDgWbFqEUJ4eEhKwAC7aYIYUhvoI/8k+4u64nsyEJQdHXmB+OY3WE5TegYUCuqSsdPY74eO1o8dDgxF363eggDSBmYqSSs+Tpu9TNhJG7iJFX1tiAPwmKvjVrJOac= ozeneva@omri", "key_options": null, "keyfile": "/home/ozeneva/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ozeneva", "validate_certs": true} 2021-07-26T15:30:21.155 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "matan", "ovpn": "matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICYMwYvykHtnVhhJwcKaiRh9oMpJkqvEA7OAbHPYOv6W matan.brz@gmail.com", "key_options": null, "keyfile": "/home/matan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "matan", "validate_certs": true} 2021-07-26T15:30:21.250 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDepyzA+MeQT5oRM52SxmUUKVAzkcrH/NqFxoCpBAjUSioTMaB1h0PhHE00nvHnKRvqWdPl8LCBWS3Ncjh30r9lwHaP+oPy4iLQEc7D2Mwn7WyPh5cq9N3UF25C0AlMG744k1tBNb97qy73OJI+oc5pAj4vUpCC1Ut9pMP5E5pQCx/kwgSOpC7mk0dYr/H5FxjPb0ca55eisFTLXraHPSChdrHjlYC5XpOZ9csilTwFdF0fJdu0nMDwIxGvwTOaUcIcfNLkpGB2Sj/pAM4L9pVsIbeE3C8d978MZ8Ff+ksQ0T8eNzew2ZjSkSuV+oR1sBCJYZ7mbDQuYLKAs5DanO1VFJvgjBJm1zP2ONu+g0fn/j04qIosuudziwoG/dOTkFo+6dBvF5hQi7TbZOIUVFr5dBlGS+O4eoK0gi/wpzun227E4dadY9uB1wiZ/PTD/5og+gxWG32RkHqqX3ALlK4m8JKzrq214nZ7Dt9CNewiUkR15uRkDasGIdiu6qb4Ez8= ArunaSudhan@sudhan-linux", "key_options": null, "keyfile": "/home/sudhanaruna/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sudhanaruna", "validate_certs": true} 2021-07-26T15:30:21.292 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkFTEUxQkQ1cplOLOf86Teu4qTYGkMqWtjIwzsU/AcimjFolSI5fJ3B72PH7bhQKkSnOlTjiOos2LrD5i/XgxkJD6icVWwHO11lczsq/8K5x0ZMJbJaiT3QphBB4yItoge2Y4/7g4o/78Ne+U7eZ1L5fgeO1fExtIaEXK1lS8pVlpZQXyproTIzp1WLHoaXb38Mxc5jAtuvEKfEycdX3c8k/9ti2qBCZnmjPH05WOxkqCRyNBT+bSJZyFMYt9RDUuycn3BYVSXTAzPW0qwgvKY5vij+qiFoxij7nKNMH7w6C0arolCcJxhiMyEF3UbTuOxgVONWyqFk/vScGGSYj9ytQYjv0L1cFyOVhlpbu+tnptulfQ3faMpjROE/eYxTIoY7OPDgWbFqEUJ4eEhKwAC7aYIYUhvoI/8k+4u64nsyEJQdHXmB+OY3WE5TegYUCuqSsdPY74eO1o8dDgxF363eggDSBmYqSSs+Tpu9TNhJG7iJFX1tiAPwmKvjVrJOac= ozeneva@omri", "key_options": null, "keyfile": "/home/ozeneva/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ozeneva", "validate_certs": true} 2021-07-26T15:30:21.386 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuHIpWAz6Sk3ATLvTG4KS24JUzgqQBEm4EesPgf1cEG+xK4gISUixaVC9OSNS/KR+8/yoWAhmw992p8cp7mWXxqrRC9kIrthLWvD6Jjz3HTXgarO2oNibeVu27kK/Fm2vvUNACARBkoC5YXd6IuoZOEg1bJu06DLw5Y7pGMqZRVDOrE8WUDwr27roZSgU2/N+18Y1LYn4gwSvWpuC/IotLyGSpW7/dgrZAIreRoYboMdTSlIjjuzeWvYx/AnZmkeEo0IhfyuBRl7ZQwxSFYHn9Z1+iQkt+O9hEZYSZuYRuyFPRqHNMKCEj1iYVRMcwbf/x2/dhjfmbWmjOMJoNNwm+DpixHHbId6Idx82GlAtCgQSTe9aG783oCeZYuVUr1plIRjeEsdjY9UBRYKNknEAChKjMSbxysvO3Dy4yrU2r8qo1iBS1fi4HUg12asCLrJX7vSCvOhOn7ltqDTmt5UiLSn+eCzXpOTBDWz7McB28FoYyR+Rwz5GOH3ITFhPyhXc= wzl@manjaro-wzl", "key_options": null, "keyfile": "/home/zl31wang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zl31wang", "validate_certs": true} 2021-07-26T15:30:21.418 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDepyzA+MeQT5oRM52SxmUUKVAzkcrH/NqFxoCpBAjUSioTMaB1h0PhHE00nvHnKRvqWdPl8LCBWS3Ncjh30r9lwHaP+oPy4iLQEc7D2Mwn7WyPh5cq9N3UF25C0AlMG744k1tBNb97qy73OJI+oc5pAj4vUpCC1Ut9pMP5E5pQCx/kwgSOpC7mk0dYr/H5FxjPb0ca55eisFTLXraHPSChdrHjlYC5XpOZ9csilTwFdF0fJdu0nMDwIxGvwTOaUcIcfNLkpGB2Sj/pAM4L9pVsIbeE3C8d978MZ8Ff+ksQ0T8eNzew2ZjSkSuV+oR1sBCJYZ7mbDQuYLKAs5DanO1VFJvgjBJm1zP2ONu+g0fn/j04qIosuudziwoG/dOTkFo+6dBvF5hQi7TbZOIUVFr5dBlGS+O4eoK0gi/wpzun227E4dadY9uB1wiZ/PTD/5og+gxWG32RkHqqX3ALlK4m8JKzrq214nZ7Dt9CNewiUkR15uRkDasGIdiu6qb4Ez8= ArunaSudhan@sudhan-linux", "key_options": null, "keyfile": "/home/sudhanaruna/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sudhanaruna", "validate_certs": true} 2021-07-26T15:30:21.513 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIi8JMOVD91QR7EXBkhxeAsB2UO2gyWqYPiP6HjJO/TzzMKf7QtO928XzdORwQ1/jm2hDF1kaNPaU/XIHD0hHSvfICS4ELQcBPa5uPya6d5Kn5fVlpGqBcXBxKGbHB01PGjn0214eupt2LebWxkm7TP/BGDHKXXaoR748AlbyyG2L3TaNoGkwQiEoZe3CWgH4qkrf2CEpyfOa7BM7U0h+lceJxIGe+Yo6Ll14zyngDBa059E+ndFTpkQ6vECII7FdB1+A4Orhu40XHZgyVnlRudD1l80pIVnZves8N2zHZhQo8hp0sB5oY8HENiB09j7Xa6YQ/c1c2wm9E2xJHSNo7muFiHz48vQEgvNmu0lZdbVwXIy3IgLEBHjs6Kyqjtg618V4UaoP/LBOqtWtLd6TvGJ3qBlNyvhO5gZ2DGeLMN2WWoHxfl3VM+QGCGI2dnzUyHhfG1VBDYj8fzWXOuUVpVCMUw8fEg8GWmYLDwm3SbdMACWU87J0kAmaDPKcwwL6AwtWJZr/p89sSypl6y50JlOoDrbDbxrIbHQgbf1tcEgPOuLUN+O06qpi+OxKMtFdbvz+NQ4V4CpXpvMMQZj5AbuHp0EJ5Vme/Kcmpl/xoYGyFDzOEGR8lw6LMz+CpQ4GtnK5XXe1Xn3TJh6Tn2tVyS20p7artemGQQquCN8iQOw== mayag@gett.com", "key_options": null, "keyfile": "/home/mayagilad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mayagilad", "validate_certs": true} 2021-07-26T15:30:21.604 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuHIpWAz6Sk3ATLvTG4KS24JUzgqQBEm4EesPgf1cEG+xK4gISUixaVC9OSNS/KR+8/yoWAhmw992p8cp7mWXxqrRC9kIrthLWvD6Jjz3HTXgarO2oNibeVu27kK/Fm2vvUNACARBkoC5YXd6IuoZOEg1bJu06DLw5Y7pGMqZRVDOrE8WUDwr27roZSgU2/N+18Y1LYn4gwSvWpuC/IotLyGSpW7/dgrZAIreRoYboMdTSlIjjuzeWvYx/AnZmkeEo0IhfyuBRl7ZQwxSFYHn9Z1+iQkt+O9hEZYSZuYRuyFPRqHNMKCEj1iYVRMcwbf/x2/dhjfmbWmjOMJoNNwm+DpixHHbId6Idx82GlAtCgQSTe9aG783oCeZYuVUr1plIRjeEsdjY9UBRYKNknEAChKjMSbxysvO3Dy4yrU2r8qo1iBS1fi4HUg12asCLrJX7vSCvOhOn7ltqDTmt5UiLSn+eCzXpOTBDWz7McB28FoYyR+Rwz5GOH3ITFhPyhXc= wzl@manjaro-wzl", "key_options": null, "keyfile": "/home/zl31wang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zl31wang", "validate_certs": true} 2021-07-26T15:30:21.626 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:21 +0000 (0:00:20.624) 0:00:59.181 *********** 2021-07-26T15:30:21.678 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIi8JMOVD91QR7EXBkhxeAsB2UO2gyWqYPiP6HjJO/TzzMKf7QtO928XzdORwQ1/jm2hDF1kaNPaU/XIHD0hHSvfICS4ELQcBPa5uPya6d5Kn5fVlpGqBcXBxKGbHB01PGjn0214eupt2LebWxkm7TP/BGDHKXXaoR748AlbyyG2L3TaNoGkwQiEoZe3CWgH4qkrf2CEpyfOa7BM7U0h+lceJxIGe+Yo6Ll14zyngDBa059E+ndFTpkQ6vECII7FdB1+A4Orhu40XHZgyVnlRudD1l80pIVnZves8N2zHZhQo8hp0sB5oY8HENiB09j7Xa6YQ/c1c2wm9E2xJHSNo7muFiHz48vQEgvNmu0lZdbVwXIy3IgLEBHjs6Kyqjtg618V4UaoP/LBOqtWtLd6TvGJ3qBlNyvhO5gZ2DGeLMN2WWoHxfl3VM+QGCGI2dnzUyHhfG1VBDYj8fzWXOuUVpVCMUw8fEg8GWmYLDwm3SbdMACWU87J0kAmaDPKcwwL6AwtWJZr/p89sSypl6y50JlOoDrbDbxrIbHQgbf1tcEgPOuLUN+O06qpi+OxKMtFdbvz+NQ4V4CpXpvMMQZj5AbuHp0EJ5Vme/Kcmpl/xoYGyFDzOEGR8lw6LMz+CpQ4GtnK5XXe1Xn3TJh6Tn2tVyS20p7artemGQQquCN8iQOw== mayag@gett.com", "key_options": null, "keyfile": "/home/mayagilad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mayagilad", "validate_certs": true} 2021-07-26T15:30:21.747 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-07-26T15:30:21.749 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ 2021-07-26T15:30:21.750 INFO:teuthology.task.ansible.out:ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcN 2021-07-26T15:30:21.752 INFO:teuthology.task.ansible.out:E/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:21.773 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:21 +0000 (0:00:00.146) 0:00:59.328 *********** 2021-07-26T15:30:21.782 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:21.784 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:21.872 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:21.883 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:21.894 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:21.905 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:21.907 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:21.917 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-07-26T15:30:21.919 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:21.929 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:21.931 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:21.941 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:21.942 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.062 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-07-26T15:30:22.084 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-07-26T15:30:22.096 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.107 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.192 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-07-26T15:30:22.203 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.204 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.216 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.227 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.228 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.238 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.240 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-07-26T15:30:22.241 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.258 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.260 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.270 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.272 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.282 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.284 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.294 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.296 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.306 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.307 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.317 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.328 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.330 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.340 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.351 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.352 INFO:teuthology.task.ansible.out: skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.353 INFO:teuthology.task.ansible.out: 2021-07-26T15:30:22.363 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.374 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.377 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.386 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.387 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-07-26T15:30:22.389 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.400 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.401 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.402 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.403 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.405 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.418 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.429 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.431 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.442 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.453 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.456 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.467 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.468 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.470 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.482 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.484 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.498 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.505 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.506 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.517 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.518 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.520 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.530 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.532 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.543 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.544 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.555 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.557 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.557 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.568 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.571 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.582 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.584 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.595 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.597 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.597 INFO:teuthology.task.ansible.out: 2021-07-26T15:30:22.608 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.610 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.621 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.623 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.634 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.635 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.635 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.637 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.648 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.648 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.650 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.650 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.664 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.666 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.666 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.678 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.679 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.680 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': ' 2021-07-26T15:30:22.683 INFO:teuthology.task.ansible.out:soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.693 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.705 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.716 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.718 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.729 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.731 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.742 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.744 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.756 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.768 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.779 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.781 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.792 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.793 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.804 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.806 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.817 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.819 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.829 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.831 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.832 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.843 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.845 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.855 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.856 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.867 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.870 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.879 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.881 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.892 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.895 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.905 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.918 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.930 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.942 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.953 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.955 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.965 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.967 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.979 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.980 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.980 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.981 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.992 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:22.993 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:23.004 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:23.006 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:23.017 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:23.019 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:23.029 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:23.031 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:23.042 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:23.044 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:23.053 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:23.055 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:23.065 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:23.068 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "matan", "ovpn": "matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa"}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:23.078 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:23.080 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:23.091 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:23.093 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:23.111 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:23.113 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:23.135 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:23 +0000 (0:00:01.361) 0:01:00.690 *********** 2021-07-26T15:30:23.142 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:23.145 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:23.157 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:23.160 INFO:teuthology.task.ansible.out: skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:23.170 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:23.170 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:23.183 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:23.184 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:23.194 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:23.205 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:23.206 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:23.218 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} TASK [Filter the revoked_users list] ******************************************* 2021-07-26T15:30:23.222 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:23.241 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:23 +0000 (0:00:00.106) 0:01:00.797 *********** 2021-07-26T15:30:23.249 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-07-26T15:30:23.251 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:23.251 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:23.252 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:23.264 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:23.265 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:23.276 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:23.278 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:23.287 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:23.289 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:23.299 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:23.312 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "matan", "ovpn": "matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa"}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:23.324 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:23.336 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:23.378 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:23 +0000 (0:00:00.136) 0:01:00.933 *********** 2021-07-26T15:30:23.447 INFO:teuthology.task.ansible.out: TASK [Filter the revoked_users list] ******************************************* 2021-07-26T15:30:23.449 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:23.470 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:23 +0000 (0:00:00.092) 0:01:01.025 *********** 2021-07-26T15:30:23.477 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-07-26T15:30:23.478 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-07-26T15:30:23.594 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-07-26T15:30:23.678 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-07-26T15:30:23.731 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-07-26T15:30:23.827 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-07-26T15:30:23.870 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-07-26T15:30:23.954 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-07-26T15:30:24.007 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-07-26T15:30:24.093 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-07-26T15:30:24.146 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-07-26T15:30:24.232 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-07-26T15:30:24.285 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-07-26T15:30:24.370 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-07-26T15:30:24.433 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-07-26T15:30:24.508 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-07-26T15:30:24.571 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-07-26T15:30:24.634 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-07-26T15:30:24.699 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-07-26T15:30:24.773 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-07-26T15:30:24.836 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-07-26T15:30:24.903 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-07-26T15:30:24.966 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-07-26T15:30:25.040 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-07-26T15:30:25.042 INFO:teuthology.task.ansible.out: 2021-07-26T15:30:25.104 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-07-26T15:30:25.182 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-07-26T15:30:25.235 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-07-26T15:30:25.310 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-07-26T15:30:25.363 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-07-26T15:30:25.446 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-07-26T15:30:25.499 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-07-26T15:30:25.593 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-07-26T15:30:25.635 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-07-26T15:30:25.719 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-07-26T15:30:25.774 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-07-26T15:30:25.859 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-07-26T15:30:25.913 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-07-26T15:30:25.988 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-07-26T15:30:26.043 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-07-26T15:30:26.128 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-07-26T15:30:26.181 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-07-26T15:30:26.255 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-07-26T15:30:26.321 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-07-26T15:30:26.396 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-07-26T15:30:26.461 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-07-26T15:30:26.538 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-07-26T15:30:26.591 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-07-26T15:30:26.675 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-07-26T15:30:26.727 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-07-26T15:30:26.812 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-07-26T15:30:26.865 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-07-26T15:30:26.939 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-07-26T15:30:27.003 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-07-26T15:30:27.089 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-07-26T15:30:27.141 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-07-26T15:30:27.225 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-07-26T15:30:27.278 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-07-26T15:30:27.362 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-07-26T15:30:27.416 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-07-26T15:30:27.490 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-07-26T15:30:27.564 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-07-26T15:30:27.626 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-07-26T15:30:27.690 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-07-26T15:30:27.753 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-07-26T15:30:27.838 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-07-26T15:30:27.891 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-07-26T15:30:27.976 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-07-26T15:30:28.020 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-07-26T15:30:28.114 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-07-26T15:30:28.158 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-07-26T15:30:28.253 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-07-26T15:30:28.306 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-07-26T15:30:28.393 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-07-26T15:30:28.458 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-07-26T15:30:28.533 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-07-26T15:30:28.596 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-07-26T15:30:28.733 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-07-26T15:30:29.039 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "jdillaman", "name": "jdillaman", "remove": false, "state": "absent"} 2021-07-26T15:30:29.178 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-07-26T15:30:29.207 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "jdillaman", "name": "jdillaman", "remove": false, "state": "absent"} 2021-07-26T15:30:29.304 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-07-26T15:30:29.347 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-07-26T15:30:29.451 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-07-26T15:30:29.484 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-07-26T15:30:29.581 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-07-26T15:30:29.624 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-07-26T15:30:29.708 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-07-26T15:30:29.768 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-07-26T15:30:29.842 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-07-26T15:30:29.895 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-07-26T15:30:29.981 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-07-26T15:30:30.023 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-07-26T15:30:30.117 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-07-26T15:30:30.160 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-07-26T15:30:30.255 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-07-26T15:30:30.298 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-07-26T15:30:30.408 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-07-26T15:30:30.430 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-07-26T15:30:30.455 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:30 +0000 (0:00:06.984) 0:01:08.010 *********** 2021-07-26T15:30:30.560 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-07-26T15:30:30.614 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:30 +0000 (0:00:00.159) 0:01:08.169 *********** 2021-07-26T15:30:30.872 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-07-26T15:30:30.874 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"changed": true, "checksum": "6b66beacdb1c95b0ac86e1041f3914cfa0c50311", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "e34309bf71492baa6798d79247cca3d0", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1627313430.5458703-16311-41059015635383/source", "state": "file", "uid": 0} 2021-07-26T15:30:30.899 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:30 +0000 (0:00:00.285) 0:01:08.454 *********** 2021-07-26T15:30:30.969 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-07-26T15:30:30.971 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => { "msg": "Host smithi197.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2021-07-26T15:30:30.994 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:30 +0000 (0:00:00.094) 0:01:08.549 *********** 2021-07-26T15:30:31.053 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-07-26T15:30:31.055 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => {"changed": true, "checksum": "6b66beacdb1c95b0ac86e1041f3914cfa0c50311", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "e34309bf71492baa6798d79247cca3d0", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1627313430.7262032-16341-269506478346603/source", "state": "file", "uid": 0} 2021-07-26T15:30:31.078 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:31 +0000 (0:00:00.083) 0:01:08.633 *********** 2021-07-26T15:30:31.095 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-07-26T15:30:31.097 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-07-26T15:30:31.126 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:31 +0000 (0:00:00.048) 0:01:08.681 *********** 2021-07-26T15:30:31.154 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-07-26T15:30:31.156 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => { "msg": "Host smithi183.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2021-07-26T15:30:31.180 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:31 +0000 (0:00:00.052) 0:01:08.734 *********** 2021-07-26T15:30:31.196 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-07-26T15:30:31.198 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:31.221 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:31 +0000 (0:00:00.041) 0:01:08.776 *********** 2021-07-26T15:30:31.259 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-07-26T15:30:31.262 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-07-26T15:30:31.284 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:31 +0000 (0:00:00.063) 0:01:08.839 *********** 2021-07-26T15:30:31.326 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:31.350 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:31 +0000 (0:00:00.065) 0:01:08.905 *********** 2021-07-26T15:30:31.367 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:31.393 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:31 +0000 (0:00:00.042) 0:01:08.948 *********** 2021-07-26T15:30:31.431 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-07-26T15:30:31.433 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:31.457 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:31 +0000 (0:00:00.064) 0:01:09.012 *********** 2021-07-26T15:30:31.466 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-07-26T15:30:31.468 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:31.497 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:31 +0000 (0:00:00.039) 0:01:09.052 *********** 2021-07-26T15:30:31.526 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:31.552 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:31 +0000 (0:00:00.055) 0:01:09.108 *********** 2021-07-26T15:30:31.569 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-07-26T15:30:31.571 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:31.598 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:31 +0000 (0:00:00.045) 0:01:09.153 *********** 2021-07-26T15:30:31.616 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-07-26T15:30:31.618 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:31.642 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:31 +0000 (0:00:00.043) 0:01:09.197 *********** 2021-07-26T15:30:31.660 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2021-07-26T15:30:31.662 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:31.687 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:31 +0000 (0:00:00.044) 0:01:09.242 *********** 2021-07-26T15:30:31.705 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-07-26T15:30:31.707 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:31.733 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:31 +0000 (0:00:00.045) 0:01:09.287 *********** 2021-07-26T15:30:31.760 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-07-26T15:30:31.762 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:31.787 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:31 +0000 (0:00:00.054) 0:01:09.342 *********** 2021-07-26T15:30:31.804 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-07-26T15:30:31.805 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:31.829 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:31 +0000 (0:00:00.041) 0:01:09.384 *********** 2021-07-26T15:30:31.857 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-07-26T15:30:31.858 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:31.883 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:31 +0000 (0:00:00.053) 0:01:09.438 *********** 2021-07-26T15:30:31.900 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-07-26T15:30:31.901 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:31.925 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:31 +0000 (0:00:00.041) 0:01:09.480 *********** 2021-07-26T15:30:31.962 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-07-26T15:30:31.964 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:31.986 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:31 +0000 (0:00:00.061) 0:01:09.541 *********** 2021-07-26T15:30:32.004 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-07-26T15:30:32.006 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi197.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-07-26T15:30:32.029 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:32 +0000 (0:00:00.043) 0:01:09.584 *********** 2021-07-26T15:30:32.058 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-07-26T15:30:32.059 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:32.086 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:32 +0000 (0:00:00.057) 0:01:09.642 *********** 2021-07-26T15:30:32.106 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-07-26T15:30:32.108 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:32.142 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:32 +0000 (0:00:00.055) 0:01:09.697 *********** 2021-07-26T15:30:32.144 INFO:teuthology.task.ansible.out: 2021-07-26T15:30:32.184 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-07-26T15:30:32.186 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi183.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-07-26T15:30:32.211 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:32 +0000 (0:00:00.068) 0:01:09.766 *********** 2021-07-26T15:30:32.228 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-07-26T15:30:32.229 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:32.253 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:32 +0000 (0:00:00.041) 0:01:09.808 *********** 2021-07-26T15:30:32.279 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-07-26T15:30:32.281 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:32.303 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:32 +0000 (0:00:00.050) 0:01:09.858 *********** 2021-07-26T15:30:32.320 INFO:teuthology.task.ansible.out: TASK [common : Set the releasever] ********************************************* 2021-07-26T15:30:32.322 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:32.353 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:32 +0000 (0:00:00.049) 0:01:09.908 *********** 2021-07-26T15:30:32.390 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-07-26T15:30:32.392 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:32.418 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:32 +0000 (0:00:00.062) 0:01:09.970 *********** 2021-07-26T15:30:32.432 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-07-26T15:30:32.434 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-07-26T15:30:32.457 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:32 +0000 (0:00:00.041) 0:01:10.012 *********** 2021-07-26T15:30:32.486 INFO:teuthology.task.ansible.out: TASK [common : Set the releasever] ********************************************* skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:32.514 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:32 +0000 (0:00:00.057) 0:01:10.069 *********** 2021-07-26T15:30:32.544 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-07-26T15:30:32.546 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:32.572 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:32 +0000 (0:00:00.058) 0:01:10.128 *********** 2021-07-26T15:30:32.590 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-07-26T15:30:32.591 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-07-26T15:30:32.616 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:32 +0000 (0:00:00.043) 0:01:10.171 *********** 2021-07-26T15:30:32.657 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-07-26T15:30:32.659 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-07-26T15:30:32.682 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:32 +0000 (0:00:00.065) 0:01:10.237 *********** 2021-07-26T15:30:32.698 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-07-26T15:30:32.700 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:32.726 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:32 +0000 (0:00:00.044) 0:01:10.282 *********** 2021-07-26T15:30:32.754 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-07-26T15:30:32.756 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:32.779 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:32 +0000 (0:00:00.052) 0:01:10.334 *********** 2021-07-26T15:30:32.797 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** skipping: [smithi183.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-07-26T15:30:32.821 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:32 +0000 (0:00:00.041) 0:01:10.376 *********** 2021-07-26T15:30:32.859 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-07-26T15:30:32.861 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:32.884 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:32 +0000 (0:00:00.063) 0:01:10.440 *********** 2021-07-26T15:30:32.902 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-07-26T15:30:32.904 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:32.927 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:32 +0000 (0:00:00.042) 0:01:10.482 *********** 2021-07-26T15:30:32.954 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-07-26T15:30:32.956 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:32.983 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:32 +0000 (0:00:00.055) 0:01:10.538 *********** 2021-07-26T15:30:33.003 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:33.028 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:33 +0000 (0:00:00.045) 0:01:10.583 *********** 2021-07-26T15:30:33.057 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-07-26T15:30:33.059 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:33.082 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:33 +0000 (0:00:00.053) 0:01:10.637 *********** 2021-07-26T15:30:33.099 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-07-26T15:30:33.101 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:33.124 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:33 +0000 (0:00:00.042) 0:01:10.680 *********** 2021-07-26T15:30:33.153 INFO:teuthology.task.ansible.out: 2021-07-26T15:30:33.155 INFO:teuthology.task.ansible.out:TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* skipping: [smithi197.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-07-26T15:30:33.179 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:33 +0000 (0:00:00.054) 0:01:10.734 *********** 2021-07-26T15:30:33.195 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-07-26T15:30:33.197 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:33.221 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:33 +0000 (0:00:00.042) 0:01:10.777 *********** 2021-07-26T15:30:33.251 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-07-26T15:30:33.253 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:33.276 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:33 +0000 (0:00:00.055) 0:01:10.832 *********** 2021-07-26T15:30:33.326 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-07-26T15:30:33.328 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-07-26T15:30:33.355 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:33 +0000 (0:00:00.078) 0:01:10.910 *********** 2021-07-26T15:30:33.362 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-07-26T15:30:33.363 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:33.388 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:33 +0000 (0:00:00.032) 0:01:10.943 *********** 2021-07-26T15:30:33.416 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:33.440 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:33 +0000 (0:00:00.052) 0:01:10.995 *********** 2021-07-26T15:30:33.458 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-07-26T15:30:33.460 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:33.484 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:33 +0000 (0:00:00.044) 0:01:11.040 *********** 2021-07-26T15:30:33.513 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:33.537 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:33 +0000 (0:00:00.052) 0:01:11.092 *********** 2021-07-26T15:30:33.555 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:33.582 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:33 +0000 (0:00:00.044) 0:01:11.137 *********** 2021-07-26T15:30:33.612 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-07-26T15:30:33.614 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:33.637 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:33 +0000 (0:00:00.055) 0:01:11.192 *********** 2021-07-26T15:30:33.656 INFO:teuthology.task.ansible.out: 2021-07-26T15:30:33.658 INFO:teuthology.task.ansible.out:TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:33.681 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:33 +0000 (0:00:00.044) 0:01:11.237 *********** 2021-07-26T15:30:33.709 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-07-26T15:30:33.711 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:33.734 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:33 +0000 (0:00:00.052) 0:01:11.289 *********** 2021-07-26T15:30:33.772 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-07-26T15:30:33.773 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:33.797 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:33 +0000 (0:00:00.062) 0:01:11.352 *********** 2021-07-26T15:30:33.813 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-07-26T15:30:33.815 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:33.838 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:33 +0000 (0:00:00.041) 0:01:11.393 *********** 2021-07-26T15:30:33.865 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-07-26T15:30:33.867 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-07-26T15:30:33.890 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:33 +0000 (0:00:00.051) 0:01:11.445 *********** 2021-07-26T15:30:33.928 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-07-26T15:30:33.930 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:33.958 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:33 +0000 (0:00:00.068) 0:01:11.513 *********** 2021-07-26T15:30:33.968 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:33.994 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:33 +0000 (0:00:00.035) 0:01:11.549 *********** 2021-07-26T15:30:34.022 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-07-26T15:30:34.024 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-07-26T15:30:34.047 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:34 +0000 (0:00:00.053) 0:01:11.602 *********** 2021-07-26T15:30:34.064 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-07-26T15:30:34.066 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:34.090 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:34 +0000 (0:00:00.042) 0:01:11.645 *********** 2021-07-26T15:30:34.118 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:34.143 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:34 +0000 (0:00:00.052) 0:01:11.698 *********** 2021-07-26T15:30:34.161 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:34.186 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:34 +0000 (0:00:00.043) 0:01:11.741 *********** 2021-07-26T15:30:34.214 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-07-26T15:30:34.216 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:34.239 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:34 +0000 (0:00:00.052) 0:01:11.794 *********** 2021-07-26T15:30:34.266 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-07-26T15:30:34.268 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:34.278 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:34.303 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:34 +0000 (0:00:00.064) 0:01:11.858 *********** 2021-07-26T15:30:34.309 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-07-26T15:30:34.311 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:34.335 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:34 +0000 (0:00:00.032) 0:01:11.890 *********** 2021-07-26T15:30:34.388 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* skipping: [smithi197.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} 2021-07-26T15:30:34.390 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-07-26T15:30:34.415 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:34 +0000 (0:00:00.080) 0:01:11.971 *********** 2021-07-26T15:30:34.432 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-07-26T15:30:34.434 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:34.460 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:34 +0000 (0:00:00.044) 0:01:12.015 *********** 2021-07-26T15:30:34.489 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-07-26T15:30:34.490 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:34.513 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:34 +0000 (0:00:00.052) 0:01:12.068 *********** 2021-07-26T15:30:34.540 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-07-26T15:30:34.542 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-07-26T15:30:34.571 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:34 +0000 (0:00:00.057) 0:01:12.126 *********** 2021-07-26T15:30:34.645 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:34.668 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:34 +0000 (0:00:00.097) 0:01:12.223 *********** 2021-07-26T15:30:34.717 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-07-26T15:30:34.718 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.014647", "end": "2021-07-26 15:30:34.794487", "rc": 0, "start": "2021-07-26 15:30:34.779840", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-07-26T15:30:34.742 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:34 +0000 (0:00:00.074) 0:01:12.298 *********** 2021-07-26T15:30:34.848 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:34.871 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:34 +0000 (0:00:00.129) 0:01:12.427 *********** 2021-07-26T15:30:34.873 INFO:teuthology.task.ansible.out: 2021-07-26T15:30:34.879 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-07-26T15:30:34.880 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.015056", "end": "2021-07-26 15:30:35.319884", "rc": 0, "start": "2021-07-26 15:30:35.304828", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-07-26T15:30:34.906 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:34 +0000 (0:00:00.034) 0:01:12.461 *********** 2021-07-26T15:30:34.946 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:34.972 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:34 +0000 (0:00:00.065) 0:01:12.527 *********** 2021-07-26T15:30:34.978 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-07-26T15:30:34.980 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:35.006 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:35 +0000 (0:00:00.032) 0:01:12.560 *********** 2021-07-26T15:30:35.086 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-07-26T15:30:35.088 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:35.110 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:35 +0000 (0:00:00.104) 0:01:12.665 *********** 2021-07-26T15:30:35.724 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-07-26T15:30:35.726 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "name": "sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "sleep.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit sleep.target is masked.\"", "LoadState": "masked", "Names": "sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} ok: [smithi183.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "name": "sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "sleep.target", "FailureAction": "none", "FragmentPat 2021-07-26T15:30:35.727 INFO:teuthology.task.ansible.out:h": "/dev/null", "Id": "sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit sleep.target is masked.\"", "LoadState": "masked", "Names": "sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-07-26T15:30:35.895 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "name": "suspend.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "suspend.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "suspend.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit suspend.target is masked.\"", "LoadState": "masked", "Names": "suspend.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-07-26T15:30:35.909 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "name": "suspend.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "suspend.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "suspend.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit suspend.target is masked.\"", "LoadState": "masked", "Names": "suspend.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-07-26T15:30:36.088 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "name": "hibernate.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hibernate.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "hibernate.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hibernate.target is masked.\"", "LoadState": "masked", "Names": "hibernate.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-07-26T15:30:36.089 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "name": "hibernate.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hibernate.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "hibernate.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hibernate.target is masked.\"", "LoadState": "masked", "Names": "hibernate.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-07-26T15:30:36.257 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "name": "hybrid-sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hybrid-sleep.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "hybrid-sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hybrid-sleep.target is masked.\"", "LoadState": "masked", "Names": "hybrid-sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-07-26T15:30:36.261 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "name": "hybrid-sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hybrid-sleep.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "hybrid-sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hybrid-sleep.target is masked.\"", "LoadState": "masked", "Names": "hybrid-sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-07-26T15:30:36.286 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:36 +0000 (0:00:01.176) 0:01:13.842 *********** 2021-07-26T15:30:36.323 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:36 +0000 (0:00:00.036) 0:01:13.878 *********** 2021-07-26T15:30:36.350 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-07-26T15:30:36.352 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:36.381 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:36 +0000 (0:00:00.057) 0:01:13.935 *********** 2021-07-26T15:30:36.399 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:36.424 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:36 +0000 (0:00:00.044) 0:01:13.980 *********** 2021-07-26T15:30:36.452 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2021-07-26T15:30:36.454 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:36.478 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:36 +0000 (0:00:00.053) 0:01:14.033 *********** 2021-07-26T15:30:36.496 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:36.525 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:36 +0000 (0:00:00.047) 0:01:14.080 *********** 2021-07-26T15:30:36.527 INFO:teuthology.task.ansible.out: 2021-07-26T15:30:36.546 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:36.573 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:36 +0000 (0:00:00.047) 0:01:14.128 *********** 2021-07-26T15:30:36.601 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:36.626 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:36 +0000 (0:00:00.052) 0:01:14.181 *********** 2021-07-26T15:30:36.642 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-07-26T15:30:36.644 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:36.667 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:36 +0000 (0:00:00.041) 0:01:14.222 *********** 2021-07-26T15:30:36.694 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:36.718 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:36 +0000 (0:00:00.051) 0:01:14.274 *********** 2021-07-26T15:30:36.735 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-07-26T15:30:36.737 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:36.760 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:36 +0000 (0:00:00.042) 0:01:14.316 *********** 2021-07-26T15:30:36.789 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:36.813 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:36 +0000 (0:00:00.052) 0:01:14.369 *********** 2021-07-26T15:30:37.059 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-07-26T15:30:37.061 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.162615", "end": "2021-07-26 15:30:37.509030", "rc": 0, "start": "2021-07-26 15:30:37.346415", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:30:37.095 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:37 +0000 (0:00:00.281) 0:01:14.651 *********** 2021-07-26T15:30:37.166 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-07-26T15:30:37.168 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:37.189 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:37 +0000 (0:00:00.094) 0:01:14.745 *********** 2021-07-26T15:30:37.507 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-07-26T15:30:37.509 INFO:teuthology.task.ansible.out:[WARNING]: Consider using the apt module rather than running 'apt-get'. If you need to use command because apt is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi183.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.130211", "end": "2021-07-26 15:30:37.956292", "rc": 0, "start": "2021-07-26 15:30:37.826081", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:30:37.531 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:37 +0000 (0:00:00.341) 0:01:15.086 *********** 2021-07-26T15:30:38.429 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-07-26T15:30:38.431 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:01.483610", "end": "2021-07-26 15:30:38.511962", "rc": 0, "start": "2021-07-26 15:30:37.028352", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:30:38.455 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:38 +0000 (0:00:00.922) 0:01:16.008 *********** 2021-07-26T15:30:38.544 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-07-26T15:30:38.546 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:38.567 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:38 +0000 (0:00:00.114) 0:01:16.122 *********** 2021-07-26T15:30:38.886 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ changed: [smithi197.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.134112", "end": "2021-07-26 15:30:38.965888", "rc": 0, "start": "2021-07-26 15:30:38.831776", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:30:38.909 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:38 +0000 (0:00:00.341) 0:01:16.464 *********** 2021-07-26T15:30:43.548 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** changed: [smithi183.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1627313442, "cache_updated": true, "changed": true} 2021-07-26T15:30:43.575 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:43 +0000 (0:00:04.663) 0:01:21.128 *********** 2021-07-26T15:30:44.287 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-07-26T15:30:44.288 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => {"cache_update_time": 1627313442, "cache_updated": false, "changed": false} 2021-07-26T15:30:44.309 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:44 +0000 (0:00:00.736) 0:01:21.865 *********** 2021-07-26T15:30:44.378 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:44.401 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:44 +0000 (0:00:00.091) 0:01:21.956 *********** 2021-07-26T15:30:44.586 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** changed: [smithi197.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1627313442, "cache_updated": true, "changed": true} 2021-07-26T15:30:44.610 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:44 +0000 (0:00:00.209) 0:01:22.165 *********** 2021-07-26T15:30:45.095 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-07-26T15:30:45.097 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-07-26T15:30:45.122 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:45 +0000 (0:00:00.511) 0:01:22.677 *********** 2021-07-26T15:30:45.318 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-07-26T15:30:45.320 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"cache_update_time": 1627313442, "cache_updated": false, "changed": false} 2021-07-26T15:30:45.343 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:45 +0000 (0:00:00.221) 0:01:22.898 *********** 2021-07-26T15:30:45.412 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-07-26T15:30:45.414 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:45.434 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:45 +0000 (0:00:00.091) 0:01:22.990 *********** 2021-07-26T15:30:45.818 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-07-26T15:30:45.820 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-07-26T15:30:45.846 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:45 +0000 (0:00:00.411) 0:01:23.401 *********** 2021-07-26T15:30:45.852 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-07-26T15:30:45.854 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => {"cache_update_time": 1627313442, "cache_updated": false, "changed": false} 2021-07-26T15:30:45.881 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:45 +0000 (0:00:00.035) 0:01:23.436 *********** 2021-07-26T15:30:46.276 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-07-26T15:30:46.278 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-07-26T15:30:46.564 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-07-26T15:30:46.566 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"cache_update_time": 1627313442, "cache_updated": false, "changed": false} 2021-07-26T15:30:46.589 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:46 +0000 (0:00:00.708) 0:01:24.144 *********** 2021-07-26T15:30:46.596 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-07-26T15:30:46.598 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-07-26T15:30:46.900 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-07-26T15:30:46.926 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:46 +0000 (0:00:00.337) 0:01:24.481 *********** 2021-07-26T15:30:46.996 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-07-26T15:30:47.061 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* ok: [smithi183.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-07-26T15:30:47.085 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:47 +0000 (0:00:00.157) 0:01:24.639 *********** 2021-07-26T15:30:47.324 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-07-26T15:30:47.326 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-07-26T15:30:47.497 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi183.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-07-26T15:30:47.615 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-07-26T15:30:47.617 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-07-26T15:30:47.642 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:47 +0000 (0:00:00.558) 0:01:25.198 *********** 2021-07-26T15:30:47.778 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-07-26T15:30:47.780 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-07-26T15:30:47.804 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:47 +0000 (0:00:00.161) 0:01:25.359 *********** 2021-07-26T15:30:47.811 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-07-26T15:30:47.812 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-07-26T15:30:48.128 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": true, "checksum": "2fbc67b36d59f66fc2621f3ca2dcf60dea2167a5", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "md5sum": "fae049f2bb3feda9c19a2dc30bce838a", "mode": "0755", "owner": "root", "size": 3612, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1627313447.8073025-18097-122594224568506/source", "state": "file", "uid": 0} 2021-07-26T15:30:48.154 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:48 +0000 (0:00:00.350) 0:01:25.709 *********** 2021-07-26T15:30:48.185 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-07-26T15:30:48.240 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** ok: [smithi183.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-07-26T15:30:48.264 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:48 +0000 (0:00:00.109) 0:01:25.819 *********** 2021-07-26T15:30:48.334 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:48.357 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:48 +0000 (0:00:00.093) 0:01:25.912 *********** 2021-07-26T15:30:48.428 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* skipping: [smithi183.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-07-26T15:30:48.451 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:48 +0000 (0:00:00.093) 0:01:26.006 *********** 2021-07-26T15:30:48.479 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-07-26T15:30:48.481 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-07-26T15:30:48.543 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-07-26T15:30:48.545 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-07-26T15:30:48.565 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-07-26T15:30:48.567 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-07-26T15:30:48.577 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-07-26T15:30:48.615 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:48 +0000 (0:00:00.163) 0:01:26.170 *********** 2021-07-26T15:30:48.704 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:48.725 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:48 +0000 (0:00:00.109) 0:01:26.280 *********** 2021-07-26T15:30:48.826 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-07-26T15:30:48.828 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": true, "checksum": "2fbc67b36d59f66fc2621f3ca2dcf60dea2167a5", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "md5sum": "fae049f2bb3feda9c19a2dc30bce838a", "mode": "0755", "owner": "root", "size": 3612, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1627313448.490033-18203-59853400643546/source", "state": "file", "uid": 0} 2021-07-26T15:30:48.853 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:48 +0000 (0:00:00.127) 0:01:26.408 *********** 2021-07-26T15:30:48.931 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-07-26T15:30:48.933 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-07-26T15:30:48.955 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:48 +0000 (0:00:00.102) 0:01:26.510 *********** 2021-07-26T15:30:49.023 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:49.046 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:49 +0000 (0:00:00.091) 0:01:26.601 *********** 2021-07-26T15:30:49.125 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-07-26T15:30:49.127 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-07-26T15:30:49.148 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:49 +0000 (0:00:00.102) 0:01:26.703 *********** 2021-07-26T15:30:49.240 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-07-26T15:30:49.242 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-07-26T15:30:49.251 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-07-26T15:30:49.262 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-07-26T15:30:49.273 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-07-26T15:30:49.299 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:49 +0000 (0:00:00.148) 0:01:26.852 *********** 2021-07-26T15:30:49.378 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:49.402 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:49 +0000 (0:00:00.105) 0:01:26.958 *********** 2021-07-26T15:30:49.461 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2021-07-26T15:30:49.462 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => {"cache_update_time": 1627313442, "cache_updated": false, "changed": false} 2021-07-26T15:30:49.485 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:49 +0000 (0:00:00.082) 0:01:27.040 *********** 2021-07-26T15:30:49.860 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-07-26T15:30:49.862 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-07-26T15:30:49.884 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:49 +0000 (0:00:00.398) 0:01:27.439 *********** 2021-07-26T15:30:50.101 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2021-07-26T15:30:50.103 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"cache_update_time": 1627313442, "cache_updated": false, "changed": false} 2021-07-26T15:30:50.128 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:50 +0000 (0:00:00.244) 0:01:27.684 *********** 2021-07-26T15:30:50.280 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-07-26T15:30:50.281 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-07-26T15:30:50.306 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:50 +0000 (0:00:00.177) 0:01:27.861 *********** 2021-07-26T15:30:50.505 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-07-26T15:30:50.507 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-07-26T15:30:50.529 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:50 +0000 (0:00:00.223) 0:01:28.084 *********** 2021-07-26T15:30:50.546 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-07-26T15:30:50.548 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-07-26T15:30:50.661 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-07-26T15:30:50.687 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:50 +0000 (0:00:00.158) 0:01:28.242 *********** 2021-07-26T15:30:50.759 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:50.790 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:50 +0000 (0:00:00.103) 0:01:28.345 *********** 2021-07-26T15:30:50.903 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** skipping: [smithi183.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-07-26T15:30:50.927 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:50 +0000 (0:00:00.136) 0:01:28.482 *********** 2021-07-26T15:30:50.955 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-07-26T15:30:50.957 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-07-26T15:30:50.984 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:50 +0000 (0:00:00.056) 0:01:28.539 *********** 2021-07-26T15:30:51.005 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-07-26T15:30:51.007 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:51.031 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:51 +0000 (0:00:00.046) 0:01:28.586 *********** 2021-07-26T15:30:51.197 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-07-26T15:30:51.199 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-07-26T15:30:51.312 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-07-26T15:30:51.338 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:51 +0000 (0:00:00.307) 0:01:28.893 *********** 2021-07-26T15:30:51.407 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-07-26T15:30:51.409 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:51.431 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:51 +0000 (0:00:00.092) 0:01:28.986 *********** 2021-07-26T15:30:51.448 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-07-26T15:30:51.449 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-07-26T15:30:51.473 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:51 +0000 (0:00:00.042) 0:01:29.029 *********** 2021-07-26T15:30:51.501 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-07-26T15:30:51.503 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-07-26T15:30:51.527 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:51 +0000 (0:00:00.053) 0:01:29.082 *********** 2021-07-26T15:30:51.606 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-07-26T15:30:51.608 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:51.629 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:51 +0000 (0:00:00.102) 0:01:29.185 *********** 2021-07-26T15:30:51.730 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-07-26T15:30:51.731 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2021-07-26 15:29:15 UTC", "ActiveEnterTimestampMonotonic": "14845141", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "network.target systemd-tmpfiles-setup.service sysinit.target systemd-journald.socket local-fs.target basic.target -.mount time-sync.target nss-lookup.target var-run.mount system.slice remote-fs.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-07-26 15:29:15 UTC", "AssertTimestampMonotonic": "14843600", "Before": "getty@tty1.service multi-user.target xdm.service shutdown.target plymouth-quit.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-07-26 15:29:15 UTC", "Co 2021-07-26T15:30:51.733 INFO:teuthology.task.ansible.out:nditionTimestampMonotonic": "14843599", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "896", "ExecMainStartTimestamp": "Mon 2021-07-26 15:29:15 UTC", "ExecMainStartTimestampMonotonic": "14845001", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Mon 2021-07-26 15:29:15 UTC] ; stop_time=[n/a] ; pid=896 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[Mon 2021-07-26 15:29:15 UTC] ; stop_time=[n/a] ; pid=896 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GI 2021-07-26T15:30:51.734 INFO:teuthology.task.ansible.out:D": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2021-07-26 15:29:15 UTC", "InactiveExitTimestampMonotonic": "14845141", "InvocationID": "c42b7de9eff44e0580c1dca1181a2308", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127777", "LimitNPROCSoft": "127777", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127777", "LimitSIGPENDINGSoft": "127777", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "896", "MemoryAccounting": "yes", "MemoryCurrent": "1310720", "MemoryD 2021-07-26T15:30:51.736 INFO:teuthology.task.ansible.out:enyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-07-26 15:29:15 UTC", "StateChangeTimestampMonotonic": "14845141", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no" 2021-07-26T15:30:51.738 INFO:teuthology.task.ansible.out:, "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38333", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-07-26T15:30:51.756 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:51 +0000 (0:00:00.126) 0:01:29.311 *********** 2021-07-26T15:30:51.828 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:51.850 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:51 +0000 (0:00:00.094) 0:01:29.406 *********** 2021-07-26T15:30:51.922 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:51.943 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:51 +0000 (0:00:00.092) 0:01:29.498 *********** 2021-07-26T15:30:52.014 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:52.039 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:52 +0000 (0:00:00.096) 0:01:29.594 *********** 2021-07-26T15:30:52.046 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-07-26T15:30:52.048 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-07-26T15:30:52.074 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:52 +0000 (0:00:00.034) 0:01:29.629 *********** 2021-07-26T15:30:52.102 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:52.127 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:52 +0000 (0:00:00.053) 0:01:29.682 *********** 2021-07-26T15:30:52.200 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:52.227 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:52 +0000 (0:00:00.097) 0:01:29.779 *********** 2021-07-26T15:30:52.295 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:52.318 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:52 +0000 (0:00:00.093) 0:01:29.873 *********** 2021-07-26T15:30:52.336 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-07-26T15:30:52.337 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2021-07-26 15:27:57 UTC", "ActiveEnterTimestampMonotonic": "15773540", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "remote-fs.target systemd-tmpfiles-setup.service network.target local-fs.target -.mount system.slice basic.target nss-lookup.target systemd-journald.socket sysinit.target time-sync.target var-run.mount", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-07-26 15:27:57 UTC", "AssertTimestampMonotonic": "15755565", "Before": "shutdown.target getty@tty1.service xdm.service plymouth-quit.service multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-07-26 15:27:57 UTC", "Co 2021-07-26T15:30:52.339 INFO:teuthology.task.ansible.out:nditionTimestampMonotonic": "15755565", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "896", "ExecMainStartTimestamp": "Mon 2021-07-26 15:27:57 UTC", "ExecMainStartTimestampMonotonic": "15773367", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Mon 2021-07-26 15:27:57 UTC] ; stop_time=[n/a] ; pid=896 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[Mon 2021-07-26 15:27:57 UTC] ; stop_time=[n/a] ; pid=896 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GI 2021-07-26T15:30:52.340 INFO:teuthology.task.ansible.out:D": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2021-07-26 15:27:57 UTC", "InactiveExitTimestampMonotonic": "15773540", "InvocationID": "debbd6a1570e4350b4032078f9392e8f", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127777", "LimitNPROCSoft": "127777", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127777", "LimitSIGPENDINGSoft": "127777", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "896", "MemoryAccounting": "yes", "MemoryCurrent": "1425408", "MemoryD 2021-07-26T15:30:52.342 INFO:teuthology.task.ansible.out:enyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-07-26 15:27:57 UTC", "StateChangeTimestampMonotonic": "15773540", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no" 2021-07-26T15:30:52.344 INFO:teuthology.task.ansible.out:, "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38333", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-07-26T15:30:52.363 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:52 +0000 (0:00:00.045) 0:01:29.919 *********** 2021-07-26T15:30:52.391 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:52.417 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:52 +0000 (0:00:00.053) 0:01:29.972 *********** 2021-07-26T15:30:52.434 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2021-07-26T15:30:52.436 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:52.460 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:52 +0000 (0:00:00.043) 0:01:30.015 *********** 2021-07-26T15:30:52.462 INFO:teuthology.task.ansible.out: 2021-07-26T15:30:52.489 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-07-26T15:30:52.491 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:52.516 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:52 +0000 (0:00:00.054) 0:01:30.070 *********** 2021-07-26T15:30:52.543 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:52.567 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:52 +0000 (0:00:00.052) 0:01:30.122 *********** 2021-07-26T15:30:52.584 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-07-26T15:30:52.585 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:52.609 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:52 +0000 (0:00:00.041) 0:01:30.164 *********** 2021-07-26T15:30:52.637 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-07-26T15:30:52.639 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:52.663 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:52 +0000 (0:00:00.054) 0:01:30.218 *********** 2021-07-26T15:30:52.685 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-07-26T15:30:52.687 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:52.719 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:52 +0000 (0:00:00.056) 0:01:30.274 *********** 2021-07-26T15:30:52.759 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2021-07-26T15:30:52.761 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:52.786 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:52 +0000 (0:00:00.067) 0:01:30.341 *********** 2021-07-26T15:30:52.792 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-07-26T15:30:52.793 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-07-26T15:30:52.819 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:52 +0000 (0:00:00.032) 0:01:30.374 *********** 2021-07-26T15:30:52.860 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:52.884 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:52 +0000 (0:00:00.065) 0:01:30.440 *********** 2021-07-26T15:30:52.902 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-07-26T15:30:52.904 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-07-26T15:30:52.929 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:52 +0000 (0:00:00.044) 0:01:30.484 *********** 2021-07-26T15:30:52.946 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-07-26T15:30:52.948 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:52.971 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:52 +0000 (0:00:00.042) 0:01:30.527 *********** 2021-07-26T15:30:53.011 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-07-26T15:30:53.013 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-07-26T15:30:53.039 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:53 +0000 (0:00:00.067) 0:01:30.594 *********** 2021-07-26T15:30:53.046 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-07-26T15:30:53.048 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:53.073 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:53 +0000 (0:00:00.034) 0:01:30.628 *********** 2021-07-26T15:30:53.122 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-07-26T15:30:53.124 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-07-26T15:30:53.146 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:53 +0000 (0:00:00.072) 0:01:30.701 *********** 2021-07-26T15:30:53.153 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-07-26T15:30:53.155 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:53.179 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:53 +0000 (0:00:00.032) 0:01:30.734 *********** 2021-07-26T15:30:53.250 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-07-26T15:30:53.251 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:53.278 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:53 +0000 (0:00:00.099) 0:01:30.833 *********** 2021-07-26T15:30:53.285 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2021-07-26T15:30:53.287 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-07-26T15:30:53.311 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:53 +0000 (0:00:00.032) 0:01:30.866 *********** 2021-07-26T15:30:53.349 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:53.379 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:53 +0000 (0:00:00.066) 0:01:30.933 *********** 2021-07-26T15:30:53.451 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-07-26T15:30:53.452 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-07-26T15:30:53.488 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:53 +0000 (0:00:00.107) 0:01:31.040 *********** 2021-07-26T15:30:53.537 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-07-26T15:30:53.539 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-07-26T15:30:53.563 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:53 +0000 (0:00:00.077) 0:01:31.118 *********** 2021-07-26T15:30:53.585 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-07-26T15:30:53.587 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-07-26T15:30:53.614 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:53 +0000 (0:00:00.051) 0:01:31.169 *********** 2021-07-26T15:30:53.645 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:53.674 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:53 +0000 (0:00:00.059) 0:01:31.229 *********** 2021-07-26T15:30:53.715 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-07-26T15:30:53.717 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-07-26T15:30:53.743 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:53 +0000 (0:00:00.068) 0:01:31.298 *********** 2021-07-26T15:30:53.751 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-07-26T15:30:53.753 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:53.779 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:53 +0000 (0:00:00.036) 0:01:31.334 *********** 2021-07-26T15:30:53.851 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ ok: [smithi197.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-07-26T15:30:53.875 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:53 +0000 (0:00:00.095) 0:01:31.430 *********** 2021-07-26T15:30:53.997 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-07-26T15:30:53.998 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-07-26T15:30:54.030 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:54 +0000 (0:00:00.154) 0:01:31.584 *********** 2021-07-26T15:30:54.039 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2021-07-26T15:30:54.041 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-07-26T15:30:54.079 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:54 +0000 (0:00:00.047) 0:01:31.632 *********** 2021-07-26T15:30:54.266 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-07-26T15:30:54.293 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:54 +0000 (0:00:00.215) 0:01:31.848 *********** 2021-07-26T15:30:54.363 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-07-26T15:30:54.365 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:54.393 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:54 +0000 (0:00:00.094) 0:01:31.942 *********** 2021-07-26T15:30:54.473 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-07-26T15:30:54.475 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:54.513 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:54 +0000 (0:00:00.119) 0:01:32.062 *********** 2021-07-26T15:30:54.560 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-07-26T15:30:54.563 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-07-26T15:30:54.598 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:54 +0000 (0:00:00.090) 0:01:32.153 *********** 2021-07-26T15:30:54.672 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-07-26T15:30:54.674 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi183"}, "changed": false} 2021-07-26T15:30:54.696 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:54 +0000 (0:00:00.097) 0:01:32.251 *********** 2021-07-26T15:30:54.724 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-07-26T15:30:54.727 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-07-26T15:30:54.753 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:54 +0000 (0:00:00.056) 0:01:32.307 *********** 2021-07-26T15:30:55.235 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-07-26T15:30:55.237 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-07-26T15:30:55.259 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:55 +0000 (0:00:00.507) 0:01:32.815 *********** 2021-07-26T15:30:55.340 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* ok: [smithi197.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi197"}, "changed": false} 2021-07-26T15:30:55.363 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:55 +0000 (0:00:00.103) 0:01:32.918 *********** 2021-07-26T15:30:55.578 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2021-07-26T15:30:55.580 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi183.front.sepia.ceph.com", "ansible_hostname": "smithi183", "ansible_nodename": "smithi183"}, "changed": true, "name": "smithi183"} 2021-07-26T15:30:55.602 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:55 +0000 (0:00:00.239) 0:01:33.157 *********** 2021-07-26T15:30:55.828 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi197.front.sepia.ceph.com", "ansible_hostname": "smithi197", "ansible_nodename": "smithi197"}, "changed": true, "name": "smithi197"} 2021-07-26T15:30:55.852 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:55 +0000 (0:00:00.250) 0:01:33.407 *********** 2021-07-26T15:30:55.983 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-07-26T15:30:55.985 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-07-26T15:30:56.008 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:56 +0000 (0:00:00.155) 0:01:33.563 *********** 2021-07-26T15:30:56.244 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-07-26T15:30:56.271 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:56 +0000 (0:00:00.263) 0:01:33.827 *********** 2021-07-26T15:30:56.392 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-07-26T15:30:56.394 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-07-26T15:30:56.417 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:56 +0000 (0:00:00.145) 0:01:33.972 *********** 2021-07-26T15:30:56.644 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-07-26T15:30:56.668 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:56 +0000 (0:00:00.251) 0:01:34.224 *********** 2021-07-26T15:30:56.886 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-07-26T15:30:56.887 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-07-26T15:30:56.911 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:56 +0000 (0:00:00.242) 0:01:34.466 *********** 2021-07-26T15:30:56.980 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-07-26T15:30:56.982 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:57.005 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:57 +0000 (0:00:00.093) 0:01:34.560 *********** 2021-07-26T15:30:57.073 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-07-26T15:30:57.075 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:57.096 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:57 +0000 (0:00:00.092) 0:01:34.652 *********** 2021-07-26T15:30:57.155 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-07-26T15:30:57.156 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-07-26T15:30:57.178 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:57 +0000 (0:00:00.081) 0:01:34.734 *********** 2021-07-26T15:30:57.184 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-07-26T15:30:57.186 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:57.210 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:57 +0000 (0:00:00.031) 0:01:34.765 *********** 2021-07-26T15:30:57.248 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-07-26T15:30:57.249 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:57.272 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:57 +0000 (0:00:00.061) 0:01:34.827 *********** 2021-07-26T15:30:57.289 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:57.313 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:57 +0000 (0:00:00.041) 0:01:34.869 *********** 2021-07-26T15:30:57.351 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-07-26T15:30:57.353 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:57.375 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:57 +0000 (0:00:00.061) 0:01:34.930 *********** 2021-07-26T15:30:57.392 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-07-26T15:30:57.393 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:57.427 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:57 +0000 (0:00:00.050) 0:01:34.981 *********** 2021-07-26T15:30:57.445 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:57.474 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:57 +0000 (0:00:00.048) 0:01:35.029 *********** 2021-07-26T15:30:57.492 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-07-26T15:30:57.493 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:57.518 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:57 +0000 (0:00:00.043) 0:01:35.073 *********** 2021-07-26T15:30:57.546 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-07-26T15:30:57.548 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:57.574 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:57 +0000 (0:00:00.054) 0:01:35.127 *********** 2021-07-26T15:30:57.601 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-07-26T15:30:57.602 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:57.627 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:57 +0000 (0:00:00.054) 0:01:35.182 *********** 2021-07-26T15:30:57.644 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-07-26T15:30:57.646 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:57.670 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:57 +0000 (0:00:00.042) 0:01:35.224 *********** 2021-07-26T15:30:57.696 INFO:teuthology.task.ansible.out: TASK [testnode : Clean up Stream distro-provided repos] ************************ 2021-07-26T15:30:57.698 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:57.721 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:57 +0000 (0:00:00.052) 0:01:35.276 *********** 2021-07-26T15:30:57.739 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-07-26T15:30:57.740 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:57.765 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:57 +0000 (0:00:00.043) 0:01:35.320 *********** 2021-07-26T15:30:57.794 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:57.821 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:57 +0000 (0:00:00.056) 0:01:35.376 *********** 2021-07-26T15:30:57.843 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-07-26T15:30:57.844 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:57.870 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:57 +0000 (0:00:00.048) 0:01:35.425 *********** 2021-07-26T15:30:57.900 INFO:teuthology.task.ansible.out: TASK [testnode : Include CentOS Stream specific variables] ********************* skipping: [smithi183.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml", "skip_reason": "Conditional result was False"} 2021-07-26T15:30:57.926 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:57 +0000 (0:00:00.055) 0:01:35.480 *********** 2021-07-26T15:30:57.974 INFO:teuthology.task.ansible.out: TASK [testnode : Clean up Stream distro-provided repos] ************************ 2021-07-26T15:30:57.975 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:57.998 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:57 +0000 (0:00:00.073) 0:01:35.554 *********** 2021-07-26T15:30:58.005 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-07-26T15:30:58.007 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:58.039 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:58 +0000 (0:00:00.037) 0:01:35.592 *********** 2021-07-26T15:30:58.075 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-07-26T15:30:58.077 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:58.100 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:58 +0000 (0:00:00.063) 0:01:35.655 *********** 2021-07-26T15:30:58.106 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-07-26T15:30:58.132 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:58 +0000 (0:00:00.031) 0:01:35.687 *********** 2021-07-26T15:30:58.170 INFO:teuthology.task.ansible.out: TASK [testnode : Include CentOS Stream specific variables] ********************* 2021-07-26T15:30:58.172 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml", "skip_reason": "Conditional result was False"} 2021-07-26T15:30:58.196 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:58 +0000 (0:00:00.063) 0:01:35.751 *********** 2021-07-26T15:30:58.202 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-07-26T15:30:58.228 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:58 +0000 (0:00:00.032) 0:01:35.783 *********** 2021-07-26T15:30:58.277 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-07-26T15:30:58.279 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:58.301 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:58 +0000 (0:00:00.072) 0:01:35.856 *********** 2021-07-26T15:30:58.307 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-07-26T15:30:58.334 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:58 +0000 (0:00:00.032) 0:01:35.888 *********** 2021-07-26T15:30:58.373 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-07-26T15:30:58.397 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:58 +0000 (0:00:00.063) 0:01:35.952 *********** 2021-07-26T15:30:58.572 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:58.603 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:58 +0000 (0:00:00.205) 0:01:36.158 *********** 2021-07-26T15:30:58.646 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-07-26T15:30:58.688 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:58 +0000 (0:00:00.081) 0:01:36.240 *********** 2021-07-26T15:30:58.706 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-07-26T15:30:58.708 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-07-26T15:30:58.719 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-07-26T15:30:58.742 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:58 +0000 (0:00:00.058) 0:01:36.298 *********** 2021-07-26T15:30:58.761 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-07-26T15:30:58.797 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:58 +0000 (0:00:00.054) 0:01:36.352 *********** 2021-07-26T15:30:58.818 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2021-07-26T15:30:58.820 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:58.847 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:58 +0000 (0:00:00.049) 0:01:36.402 *********** 2021-07-26T15:30:58.876 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2021-07-26T15:30:58.879 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:58.901 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:58 +0000 (0:00:00.053) 0:01:36.456 *********** 2021-07-26T15:30:58.918 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-07-26T15:30:58.920 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:58.947 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:58 +0000 (0:00:00.043) 0:01:36.500 *********** 2021-07-26T15:30:58.983 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-07-26T15:30:58.985 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-07-26T15:30:58.994 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-07-26T15:30:59.020 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:59 +0000 (0:00:00.075) 0:01:36.575 *********** 2021-07-26T15:30:59.027 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-07-26T15:30:59.029 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:59.054 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:59 +0000 (0:00:00.033) 0:01:36.608 *********** 2021-07-26T15:30:59.092 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2021-07-26T15:30:59.093 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:59.117 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:59 +0000 (0:00:00.063) 0:01:36.672 *********** 2021-07-26T15:30:59.124 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:59.150 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:59 +0000 (0:00:00.032) 0:01:36.705 *********** 2021-07-26T15:30:59.189 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:59.218 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:59 +0000 (0:00:00.067) 0:01:36.773 *********** 2021-07-26T15:30:59.377 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-07-26T15:30:59.379 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:59.402 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:59 +0000 (0:00:00.184) 0:01:36.957 *********** 2021-07-26T15:30:59.431 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-07-26T15:30:59.433 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:59.459 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:59 +0000 (0:00:00.057) 0:01:37.014 *********** 2021-07-26T15:30:59.625 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-07-26T15:30:59.627 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:59.650 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:59 +0000 (0:00:00.191) 0:01:37.205 *********** 2021-07-26T15:30:59.680 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-07-26T15:30:59.682 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:59.717 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:59 +0000 (0:00:00.066) 0:01:37.272 *********** 2021-07-26T15:30:59.920 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-07-26T15:30:59.922 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:30:59.952 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:30:59 +0000 (0:00:00.233) 0:01:37.506 *********** 2021-07-26T15:30:59.981 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-07-26T15:30:59.983 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:00.124 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:00 +0000 (0:00:00.173) 0:01:37.679 *********** 2021-07-26T15:31:00.173 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:00.198 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:00 +0000 (0:00:00.073) 0:01:37.753 *********** 2021-07-26T15:31:00.205 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-07-26T15:31:00.206 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:00.230 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:00 +0000 (0:00:00.032) 0:01:37.786 *********** 2021-07-26T15:31:00.281 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:00.305 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:00 +0000 (0:00:00.074) 0:01:37.860 *********** 2021-07-26T15:31:00.312 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-07-26T15:31:00.314 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:00.339 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:00 +0000 (0:00:00.033) 0:01:37.894 *********** 2021-07-26T15:31:00.397 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-07-26T15:31:00.399 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:00.423 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:00 +0000 (0:00:00.084) 0:01:37.978 *********** 2021-07-26T15:31:00.431 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-07-26T15:31:00.434 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:00.460 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:00 +0000 (0:00:00.036) 0:01:38.015 *********** 2021-07-26T15:31:00.498 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-07-26T15:31:00.500 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:00.522 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:00 +0000 (0:00:00.062) 0:01:38.078 *********** 2021-07-26T15:31:00.540 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-07-26T15:31:00.541 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:00.575 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:00 +0000 (0:00:00.051) 0:01:38.129 *********** 2021-07-26T15:31:00.623 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-07-26T15:31:00.625 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:00.656 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:00 +0000 (0:00:00.081) 0:01:38.211 *********** 2021-07-26T15:31:00.665 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:00.690 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:00 +0000 (0:00:00.034) 0:01:38.246 *********** 2021-07-26T15:31:00.731 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:00.754 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:00 +0000 (0:00:00.063) 0:01:38.309 *********** 2021-07-26T15:31:00.771 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-07-26T15:31:00.773 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:00.800 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:00 +0000 (0:00:00.045) 0:01:38.355 *********** 2021-07-26T15:31:00.828 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-07-26T15:31:00.830 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:00.857 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:00 +0000 (0:00:00.056) 0:01:38.412 *********** 2021-07-26T15:31:00.885 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-07-26T15:31:00.887 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:00.911 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:00 +0000 (0:00:00.054) 0:01:38.466 *********** 2021-07-26T15:31:00.940 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2021-07-26T15:31:00.941 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:00.965 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:00 +0000 (0:00:00.053) 0:01:38.520 *********** 2021-07-26T15:31:00.993 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:01.018 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:01 +0000 (0:00:00.053) 0:01:38.573 *********** 2021-07-26T15:31:01.045 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2021-07-26T15:31:01.047 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:01.073 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:01 +0000 (0:00:00.054) 0:01:38.628 *********** 2021-07-26T15:31:01.091 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-07-26T15:31:01.093 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:01.118 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:01 +0000 (0:00:00.045) 0:01:38.674 *********** 2021-07-26T15:31:01.148 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-07-26T15:31:01.151 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:01.174 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:01 +0000 (0:00:00.055) 0:01:38.729 *********** 2021-07-26T15:31:01.192 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:01.218 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:01 +0000 (0:00:00.043) 0:01:38.773 *********** 2021-07-26T15:31:01.245 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2021-07-26T15:31:01.247 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:01.270 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:01 +0000 (0:00:00.052) 0:01:38.825 *********** 2021-07-26T15:31:01.301 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2021-07-26T15:31:01.303 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:01.332 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:01 +0000 (0:00:00.062) 0:01:38.887 *********** 2021-07-26T15:31:01.350 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-07-26T15:31:01.352 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:01.377 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:01 +0000 (0:00:00.045) 0:01:38.933 *********** 2021-07-26T15:31:01.426 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-07-26T15:31:01.428 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:01.454 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:01 +0000 (0:00:00.077) 0:01:39.010 *********** 2021-07-26T15:31:01.472 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-07-26T15:31:01.474 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:01.503 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:01 +0000 (0:00:00.045) 0:01:39.055 *********** 2021-07-26T15:31:01.517 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2021-07-26T15:31:01.519 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:01.543 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:01 +0000 (0:00:00.043) 0:01:39.099 *********** 2021-07-26T15:31:01.630 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:01.653 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:01 +0000 (0:00:00.109) 0:01:39.209 *********** 2021-07-26T15:31:01.655 INFO:teuthology.task.ansible.out: 2021-07-26T15:31:01.682 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** ok: [smithi183.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005235", "end": "2021-07-26 15:31:02.140069", "rc": 0, "start": "2021-07-26 15:31:02.134834", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:31:01.707 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:01 +0000 (0:00:00.052) 0:01:39.262 *********** 2021-07-26T15:31:01.724 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-07-26T15:31:01.726 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:01.750 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:01 +0000 (0:00:00.042) 0:01:39.304 *********** 2021-07-26T15:31:01.776 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-07-26T15:31:01.802 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:01 +0000 (0:00:00.052) 0:01:39.357 *********** 2021-07-26T15:31:01.938 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005337", "end": "2021-07-26 15:31:02.025296", "rc": 0, "start": "2021-07-26 15:31:02.019959", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:31:01.963 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:01 +0000 (0:00:00.159) 0:01:39.517 *********** 2021-07-26T15:31:02.033 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-07-26T15:31:02.056 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:02 +0000 (0:00:00.094) 0:01:39.611 *********** 2021-07-26T15:31:02.178 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** ok: [smithi183.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-07-26T15:31:02.202 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:02 +0000 (0:00:00.145) 0:01:39.757 *********** 2021-07-26T15:31:02.282 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-07-26T15:31:02.284 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:02.306 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:02 +0000 (0:00:00.103) 0:01:39.861 *********** 2021-07-26T15:31:02.438 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-07-26T15:31:02.464 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:02 +0000 (0:00:00.155) 0:01:40.017 *********** 2021-07-26T15:31:02.541 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-07-26T15:31:02.543 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:02.570 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:02 +0000 (0:00:00.107) 0:01:40.124 *********** 2021-07-26T15:31:03.549 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* ok: [smithi183.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-07-26T15:31:03.654 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-07-26T15:31:04.502 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-07-26T15:31:04.527 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:04 +0000 (0:00:01.957) 0:01:42.082 *********** 2021-07-26T15:31:04.638 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-07-26T15:31:04.663 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:04 +0000 (0:00:00.136) 0:01:42.218 *********** 2021-07-26T15:31:05.253 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-07-26T15:31:05.255 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => {"cache_update_time": 1627313442, "cache_updated": false, "changed": false} 2021-07-26T15:31:05.277 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:05 +0000 (0:00:00.613) 0:01:42.832 *********** 2021-07-26T15:31:05.347 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-07-26T15:31:05.373 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:05 +0000 (0:00:00.096) 0:01:42.929 *********** 2021-07-26T15:31:05.391 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-07-26T15:31:05.393 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"cache_update_time": 1627313442, "cache_updated": false, "changed": false} 2021-07-26T15:31:05.417 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:05 +0000 (0:00:00.043) 0:01:42.972 *********** 2021-07-26T15:31:05.486 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-07-26T15:31:05.508 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:05 +0000 (0:00:00.091) 0:01:43.063 *********** 2021-07-26T15:31:05.587 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-07-26T15:31:05.589 INFO:teuthology.task.ansible.out:[WARNING]: Consider using 'become', 'become_method', and 'become_user' rather than running sudo changed: [smithi183.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.032479", "end": "2021-07-26 15:31:06.041051", "rc": 0, "start": "2021-07-26 15:31:06.008572", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:31:05.611 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:05 +0000 (0:00:00.102) 0:01:43.166 *********** 2021-07-26T15:31:05.722 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.030907", "end": "2021-07-26 15:31:05.799586", "rc": 0, "start": "2021-07-26 15:31:05.768679", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:31:05.746 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:05 +0000 (0:00:00.134) 0:01:43.301 *********** 2021-07-26T15:31:07.854 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2021-07-26T15:31:07.856 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => {"cache_update_time": 1627313442, "cache_updated": false, "changed": false} 2021-07-26T15:31:07.879 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:07 +0000 (0:00:02.132) 0:01:45.434 *********** 2021-07-26T15:31:07.960 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"cache_update_time": 1627313442, "cache_updated": false, "changed": false} 2021-07-26T15:31:07.984 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:07 +0000 (0:00:00.105) 0:01:45.540 *********** 2021-07-26T15:31:19.474 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2021-07-26T15:31:19.476 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0\n libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla\n libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0\n libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf\n qemu-system-data qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 154 not upgraded.\nAfter this operation, 62.7 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138111 files and directories currently installed.)\r 2021-07-26T15:31:19.478 INFO:teuthology.task.ansible.out:\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-utils (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...\r\nRemoving librbd1 (15.2.8-0ubuntu0.20.04.1) ...\r\nRemoving librados2 (15.2.8-0ubuntu0.20.04.1) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0", " libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla", " libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0", " libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf", " qemu-system-data qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 154 not upgraded.", "After this operation, 62.7 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Re 2021-07-26T15:31:19.480 INFO:teuthology.task.ansible.out:ading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138111 files and directories currently installed.)", "Removing qemu-system-x86 (1:4.2-3ubuntu6.14) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.14) ...", "Removing qemu-utils (1:4.2-3ubuntu6.14) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...", "Removing librbd1 (15.2.8-0ubuntu0.20.04.1) ...", "Removing librados2 (15.2.8-0ubuntu0.20.04.1) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-07-26T15:31:19.499 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:19 +0000 (0:00:11.514) 0:01:57.054 *********** 2021-07-26T15:31:19.758 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0\n libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla\n libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0\n libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf\n qemu-system-data qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 154 not upgraded.\nAfter this operation, 62.7 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138111 files and directories currently installed.)\r 2021-07-26T15:31:19.760 INFO:teuthology.task.ansible.out:\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-utils (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...\r\nRemoving librbd1 (15.2.8-0ubuntu0.20.04.1) ...\r\nRemoving librados2 (15.2.8-0ubuntu0.20.04.1) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0", " libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla", " libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0", " libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf", " qemu-system-data qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 154 not upgraded.", "After this operation, 62.7 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Re 2021-07-26T15:31:19.761 INFO:teuthology.task.ansible.out:ading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138111 files and directories currently installed.)", "Removing qemu-system-x86 (1:4.2-3ubuntu6.14) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.14) ...", "Removing qemu-utils (1:4.2-3ubuntu6.14) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...", "Removing librbd1 (15.2.8-0ubuntu0.20.04.1) ...", "Removing librados2 (15.2.8-0ubuntu0.20.04.1) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-07-26T15:31:19.783 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:19 +0000 (0:00:00.283) 0:01:57.338 *********** 2021-07-26T15:31:44.204 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-07-26T15:31:44.206 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => {"cache_update_time": 1627313442, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0\n libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla\n libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0\n libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf\n qemu-system-data qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n apache2-bin apache2-data apache2-utils apt-utils libapt-pkg6.0\nSuggested packages:\n apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser\n apt-doc aptitude | synaptic | wajig\nThe following packages will be upgraded:\n apache2 apache2-bin apache2-data apache2-utils apt apt-utils libapt-pkg6.0\n7 upgraded, 0 newly installed, 0 to remove and 147 not upgraded.\nNeed to get 3866 kB of archives.\nAfter this operation, 42.0 kB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libapt-pkg6.0 amd64 2.0.6 [835 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apt amd64 2.0.6 [1296 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apt-utils amd64 2.0.6 [216 kB]\n 2021-07-26T15:31:44.208 INFO:teuthology.task.ansible.out:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.4 [95.5 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.4 [1180 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.4 [159 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.4 [84.0 kB]\nFetched 3866 kB in 1s (3432 kB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138039 files and directories currently installed.)\r\nPreparing to unpack .../libapt-pkg6.0_2.0.6_amd64.deb ...\r\nUnpacking libapt-pkg6.0:amd64 (2.0.6) over (2.0.4) ...\r\nSetting up libapt-pkg6.0:amd64 (2.0.6) ...\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138039 files and directories currently installed.)\r\nPreparing to unpack .../archives/apt_2.0.6_amd64.deb ...\r\nUnpacking apt (2.0.6 2021-07-26T15:31:44.210 INFO:teuthology.task.ansible.out:) over (2.0.4) ...\r\nSetting up apt (2.0.6) ...\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138039 files and directories currently installed.)\r\nPreparing to unpack .../apt-utils_2.0.6_amd64.deb ...\r\nUnpacking apt-utils (2.0.6) over (2.0.4) ...\r\nPreparing to unpack .../apache2_2.4.41-4ubuntu3.4_amd64.deb ...\r\nUnpacking apache2 (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...\r\nPreparing to unpack .../apache2-bin_2.4.41-4ubuntu3.4_amd64.deb ...\r\nUnpacking apache2-bin (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...\r\nPreparing to unpack .../apache2-data_2.4.41-4ubuntu3.4_all.deb ...\r\nUnpacking apache2-data (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...\r\nPreparing to unpack .../apache2-utils_2.4.41-4ubuntu3.4_amd64.deb ...\r\nUnpacking apache2-utils (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...\r\nSetting up apt-utils (2.0.6) ...\r\nSetting up apache2-bin (2.4.41-4ubuntu3.4) ...\r\nSetting up apache2-data (2.4.41-4ubuntu3.4) ...\r\nSetting up apache2-utils (2.4.41-4ubuntu3.4) ...\r\nSetting up apache2 (2.4.41-4ubuntu3.4) ...\r\nProcessing triggers for ufw (0.36-6) ...\r\nProcessing triggers for systemd (245.4-4ubuntu3.4) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer re 2021-07-26T15:31:44.212 INFO:teuthology.task.ansible.out:quired:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0", " libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla", " libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0", " libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf", " qemu-system-data qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " apache2-bin apache2-data apache2-utils apt-utils libapt-pkg6.0", "Suggested packages:", " apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser", " apt-doc aptitude | synaptic | wajig", "The following packages will be upgraded:", " apache2 apache2-bin apache2-data apache2-utils apt apt-utils libapt-pkg6.0", "7 upgraded, 0 newly installed, 0 to remove and 147 not upgraded.", "Need to get 3866 kB of archives.", "After this operation, 42.0 kB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libapt-pkg6.0 amd64 2.0.6 [835 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apt amd64 2.0.6 [1296 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apt-utils amd64 2.0.6 [216 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.4 [95.5 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.4 [1180 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.4 [159 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.4 [84.0 kB] 2021-07-26T15:31:44.213 INFO:teuthology.task.ansible.out:", "Fetched 3866 kB in 1s (3432 kB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading d 2021-07-26T15:31:44.214 INFO:teuthology.task.ansible.out:atabase ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138039 files and directories currently installed.)", "Preparing to unpack .../libapt-pkg6.0_2.0.6_amd64.deb ...", "Unpacking libapt-pkg6.0:amd64 (2.0.6) over (2.0.4) ...", "Setting up libapt-pkg6.0:amd64 (2.0.6) ...", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138039 files and directories currently installed.)", "Preparing to unpack .../archives/apt_2.0.6_amd64.deb ...", "Unpacking apt (2.0.6) over (2.0.4) ...", "Setting up apt (2.0.6) ...", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading dat 2021-07-26T15:31:44.216 INFO:teuthology.task.ansible.out:abase ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138039 files and directories currently installed.)", "Preparing to unpack .../apt-utils_2.0.6_amd64.deb ...", "Unpacking apt-utils (2.0.6) over (2.0.4) ...", "Preparing to unpack .../apache2_2.4.41-4ubuntu3.4_amd64.deb ...", "Unpacking apache2 (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...", "Preparing to unpack .../apache2-bin_2.4.41-4ubuntu3.4_amd64.deb ...", "Unpacking apache2-bin (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...", "Preparing to unpack .../apache2-data_2.4.41-4ubuntu3.4_all.deb ...", "Unpacking apache2-data (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...", "Preparing to unpack .../apache2-utils_2.4.41-4ubuntu3.4_amd64.deb ...", "Unpacking apache2-utils (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...", "Setting up apt-utils (2.0.6) ...", "Setting up apache2-bin (2.4.41-4ubuntu3.4) ...", "Setting up apache2-data (2.4.41-4ubuntu3.4) ...", "Setting up apache2-utils (2.4.41-4ubuntu3.4) ...", "Setting up apache2 (2.4.41-4ubuntu3.4) ...", "Processing triggers for ufw (0.36-6) ...", "Processing triggers for systemd (245.4-4ubuntu3.4) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-07-26T15:31:44.240 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:44 +0000 (0:00:24.457) 0:02:21.795 *********** 2021-07-26T15:31:44.311 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:44.334 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:44 +0000 (0:00:00.094) 0:02:21.890 *********** 2021-07-26T15:31:45.049 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-07-26T15:31:45.051 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"cache_update_time": 1627313442, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0\n libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla\n libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0\n libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf\n qemu-system-data qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n apache2-bin apache2-data apache2-utils apt-utils libapt-pkg6.0\nSuggested packages:\n apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser\n apt-doc aptitude | synaptic | wajig\nThe following packages will be upgraded:\n apache2 apache2-bin apache2-data apache2-utils apt apt-utils libapt-pkg6.0\n7 upgraded, 0 newly installed, 0 to remove and 147 not upgraded.\nNeed to get 3866 kB of archives.\nAfter this operation, 42.0 kB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libapt-pkg6.0 amd64 2.0.6 [835 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apt amd64 2.0.6 [1296 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apt-utils amd64 2.0.6 [216 kB]\n 2021-07-26T15:31:45.053 INFO:teuthology.task.ansible.out:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.4 [95.5 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.4 [1180 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.4 [159 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.4 [84.0 kB]\nFetched 3866 kB in 1s (3230 kB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138039 files and directories currently installed.)\r\nPreparing to unpack .../libapt-pkg6.0_2.0.6_amd64.deb ...\r\nUnpacking libapt-pkg6.0:amd64 (2.0.6) over (2.0.4) ...\r\nSetting up libapt-pkg6.0:amd64 (2.0.6) ...\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138039 files and directories currently installed.)\r\nPreparing to unpack .../archives/apt_2.0.6_amd64.deb ...\r\nUnpacking apt (2.0.6 2021-07-26T15:31:45.054 INFO:teuthology.task.ansible.out:) over (2.0.4) ...\r\nSetting up apt (2.0.6) ...\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138039 files and directories currently installed.)\r\nPreparing to unpack .../apt-utils_2.0.6_amd64.deb ...\r\nUnpacking apt-utils (2.0.6) over (2.0.4) ...\r\nPreparing to unpack .../apache2_2.4.41-4ubuntu3.4_amd64.deb ...\r\nUnpacking apache2 (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...\r\nPreparing to unpack .../apache2-bin_2.4.41-4ubuntu3.4_amd64.deb ...\r\nUnpacking apache2-bin (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...\r\nPreparing to unpack .../apache2-data_2.4.41-4ubuntu3.4_all.deb ...\r\nUnpacking apache2-data (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...\r\nPreparing to unpack .../apache2-utils_2.4.41-4ubuntu3.4_amd64.deb ...\r\nUnpacking apache2-utils (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...\r\nSetting up apt-utils (2.0.6) ...\r\nSetting up apache2-bin (2.4.41-4ubuntu3.4) ...\r\nSetting up apache2-data (2.4.41-4ubuntu3.4) ...\r\nSetting up apache2-utils (2.4.41-4ubuntu3.4) ...\r\nSetting up apache2 (2.4.41-4ubuntu3.4) ...\r\nProcessing triggers for ufw (0.36-6) ...\r\nProcessing triggers for systemd (245.4-4ubuntu3.4) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer re 2021-07-26T15:31:45.056 INFO:teuthology.task.ansible.out:quired:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0", " libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla", " libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0", " libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf", " qemu-system-data qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " apache2-bin apache2-data apache2-utils apt-utils libapt-pkg6.0", "Suggested packages:", " apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser", " apt-doc aptitude | synaptic | wajig", "The following packages will be upgraded:", " apache2 apache2-bin apache2-data apache2-utils apt apt-utils libapt-pkg6.0", "7 upgraded, 0 newly installed, 0 to remove and 147 not upgraded.", "Need to get 3866 kB of archives.", "After this operation, 42.0 kB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libapt-pkg6.0 amd64 2.0.6 [835 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apt amd64 2.0.6 [1296 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apt-utils amd64 2.0.6 [216 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.4 [95.5 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.4 [1180 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.4 [159 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.4 [84.0 kB] 2021-07-26T15:31:45.058 INFO:teuthology.task.ansible.out:", "Fetched 3866 kB in 1s (3230 kB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138039 files and directories currently installed.)", "Preparing to unpack .../libapt-pkg6.0_2.0.6_amd64.deb ...", "Unpacking libapt-pkg6.0:amd64 (2.0.6) over (2.0.4) ...", "Setting up libapt-pkg6.0:amd64 (2.0.6) ...", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138039 files and directories currently installed.)", "Preparing to unpack .../archives/apt_2.0.6_amd64.deb ...", "Unpacking apt (2.0.6) over (2.0.4) ...", "Setting up apt (2.0.6) ...", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading dat 2021-07-26T15:31:45.059 INFO:teuthology.task.ansible.out:abase ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138039 files and directories currently installed.)", "Preparing to unpack .../apt-utils_2.0.6_amd64.deb ...", "Unpacking apt-utils (2.0.6) over (2.0.4) ...", "Preparing to unpack .../apache2_2.4.41-4ubuntu3.4_amd64.deb ...", "Unpacking apache2 (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...", "Preparing to unpack .../apache2-bin_2.4.41-4ubuntu3.4_amd64.deb ...", "Unpacking apache2-bin (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...", "Preparing to unpack .../apache2-data_2.4.41-4ubuntu3.4_all.deb ...", "Unpacking apache2-data (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...", "Preparing to unpack .../apache2-utils_2.4.41-4ubuntu3.4_amd64.deb ...", "Unpacking apache2-utils (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...", "Setting up apt-utils (2.0.6) ...", "Setting up apache2-bin (2.4.41-4ubuntu3.4) ...", "Setting up apache2-data (2.4.41-4ubuntu3.4) ...", "Setting up apache2-utils (2.4.41-4ubuntu3.4) ...", "Setting up apache2 (2.4.41-4ubuntu3.4) ...", "Processing triggers for ufw (0.36-6) ...", "Processing triggers for systemd (245.4-4ubuntu3.4) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-07-26T15:31:45.075 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:45 +0000 (0:00:00.740) 0:02:22.630 *********** 2021-07-26T15:31:45.144 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:31:45.168 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:45 +0000 (0:00:00.092) 0:02:22.723 *********** 2021-07-26T15:31:58.788 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-07-26T15:31:58.790 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => {"cache_update_time": 1627313442, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data\n qemu-system-gui qemu-utils\nSuggested packages:\n git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk\n gitweb git-cvs git-mediawiki git-svn samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n git qemu-system-data qemu-system-gui\n3 upgraded, 6 newly installed, 0 to remove and 144 not upgraded.\nNeed to get 18.8 MB of archives.\nAfter this operation, 62.7 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 git amd64 1:2.25.1-1ubuntu3.1 [4557 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.13-0ubuntu0.20.04.1 [3212 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.13-0ubuntu0.20.04.1 [1623 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.17 [54.4 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.17 [1055 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.17 [563 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.17 [41.2 kB]\nGet:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x 2021-07-26T15:31:58.791 INFO:teuthology.task.ansible.out:86 amd64 1:4.2-3ubuntu6.17 [6738 kB]\nGet:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.17 [973 kB]\nFetched 18.8 MB in 1s (12.9 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138039 files and directories currently installed.)\r\nPreparing to unpack .../0-git_1%3a2.25.1-1ubuntu3.1_amd64.deb ...\r\nUnpacking git (1:2.25.1-1ubuntu3.1) over (1:2.25.1-1ubuntu3) ...\r\nSelecting previously unselected package librados2.\r\nPreparing to unpack .../1-librados2_15.2.13-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librados2 (15.2.13-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../2-librbd1_15.2.13-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librbd1 (15.2.13-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../3-qemu-block-extra_1%3a4.2-3ubuntu6.17_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../4-qemu-system-common_1%3a4.2-3ubuntu6.17_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.17) ...\r\nPreparing to unpack .../5-qemu-system-data_1%3a4.2-3ubuntu6.17_all.deb ...\r\nUnpacking qemu-system-data (1:4.2-3ubuntu6.17) over (1:4.2-3ubuntu6.14) ...\r\nPreparing to unpack .../6-qemu-system-gui_1%3a4.2-3ubuntu6.17_amd64.deb ...\r\nUnpacking qemu-system-gui:amd64 2021-07-26T15:31:58.793 INFO:teuthology.task.ansible.out: (1:4.2-3ubuntu6.17) over (1:4.2-3ubuntu6.14) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../7-qemu-system-x86_1%3a4.2-3ubuntu6.17_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.17) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../8-qemu-utils_1%3a4.2-3ubuntu6.17_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.17) ...\r\nSetting up librados2 (15.2.13-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.17) ...\r\nSetting up git (1:2.25.1-1ubuntu3.1) ...\r\nSetting up librbd1 (15.2.13-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-data (1:4.2-3ubuntu6.17) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.17) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.17) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.17) ...\r\nProcessing triggers for hicolor-icon-theme (0.17-2) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for mime-support (3.64ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data", " qemu-system-gui qemu-utils", "Suggested packages:", " git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk", " gitweb git-cvs git-mediawiki git-svn samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "The following packages will be upgraded:", " git qemu-system-data qemu-system-gui", "3 upgraded, 6 newly installed, 0 to remove and 144 not upgraded.", "Need to get 18.8 MB of archives.", "After this operation, 62.7 MB of additional disk space will be used.", "Get:1 http://archive. 2021-07-26T15:31:58.795 INFO:teuthology.task.ansible.out:ubuntu.com/ubuntu focal-updates/main amd64 git amd64 1:2.25.1-1ubuntu3.1 [4557 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.13-0ubuntu0.20.04.1 [3212 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.13-0ubuntu0.20.04.1 [1623 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.17 [54.4 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.17 [1055 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.17 [563 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.17 [41.2 kB]", "Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.17 [6738 kB]", "Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.17 [973 kB]", "Fetched 18.8 MB in 1s (12.9 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138039 files and directories currently installed.)", "Preparing to unpack .../0-git_1%3a2.25.1-1ubuntu3.1_amd64.deb ...", "Unpacking git (1:2.25.1-1ubuntu3.1) over (1:2.25.1-1ubuntu3) ...", "Selecting previously unselected package librados2.", "Preparing to unpack .../1-librados2_15.2.13-0ubuntu0.20.04.1_amd64.deb . 2021-07-26T15:31:58.796 INFO:teuthology.task.ansible.out:..", "Unpacking librados2 (15.2.13-0ubuntu0.20.04.1) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../2-librbd1_15.2.13-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librbd1 (15.2.13-0ubuntu0.20.04.1) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../3-qemu-block-extra_1%3a4.2-3ubuntu6.17_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../4-qemu-system-common_1%3a4.2-3ubuntu6.17_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.17) ...", "Preparing to unpack .../5-qemu-system-data_1%3a4.2-3ubuntu6.17_all.deb ...", "Unpacking qemu-system-data (1:4.2-3ubuntu6.17) over (1:4.2-3ubuntu6.14) ...", "Preparing to unpack .../6-qemu-system-gui_1%3a4.2-3ubuntu6.17_amd64.deb ...", "Unpacking qemu-system-gui:amd64 (1:4.2-3ubuntu6.17) over (1:4.2-3ubuntu6.14) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../7-qemu-system-x86_1%3a4.2-3ubuntu6.17_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.17) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../8-qemu-utils_1%3a4.2-3ubuntu6.17_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.17) ...", "Setting up librados2 (15.2.13-0ubuntu0.20.04.1) ...", "Setting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.17) ...", "Setting up git (1:2.25.1-1ubuntu3.1) ...", "Setting up librbd1 (15.2.13-0ubuntu0.20.04.1) ...", "Setting up qemu-system-data (1:4.2-3ubuntu6.17) ...", "Setting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.17) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.17) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.17) ...", "Processing triggers for hicolor-icon-theme (0.17-2) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing 2021-07-26T15:31:58.798 INFO:teuthology.task.ansible.out: triggers for mime-support (3.64ubuntu1) ..."]} 2021-07-26T15:31:58.814 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:58 +0000 (0:00:13.646) 0:02:36.369 *********** 2021-07-26T15:31:59.506 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"cache_update_time": 1627313442, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data\n qemu-system-gui qemu-utils\nSuggested packages:\n git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk\n gitweb git-cvs git-mediawiki git-svn samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n git qemu-system-data qemu-system-gui\n3 upgraded, 6 newly installed, 0 to remove and 144 not upgraded.\nNeed to get 18.8 MB of archives.\nAfter this operation, 62.7 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 git amd64 1:2.25.1-1ubuntu3.1 [4557 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.13-0ubuntu0.20.04.1 [3212 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.13-0ubuntu0.20.04.1 [1623 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.17 [54.4 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.17 [1055 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.17 [563 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.17 [41.2 kB]\nGet:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x 2021-07-26T15:31:59.508 INFO:teuthology.task.ansible.out:86 amd64 1:4.2-3ubuntu6.17 [6738 kB]\nGet:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.17 [973 kB]\nFetched 18.8 MB in 2s (10.0 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138039 files and directories currently installed.)\r\nPreparing to unpack .../0-git_1%3a2.25.1-1ubuntu3.1_amd64.deb ...\r\nUnpacking git (1:2.25.1-1ubuntu3.1) over (1:2.25.1-1ubuntu3) ...\r\nSelecting previously unselected package librados2.\r\nPreparing to unpack .../1-librados2_15.2.13-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librados2 (15.2.13-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../2-librbd1_15.2.13-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librbd1 (15.2.13-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../3-qemu-block-extra_1%3a4.2-3ubuntu6.17_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../4-qemu-system-common_1%3a4.2-3ubuntu6.17_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.17) ...\r\nPreparing to unpack .../5-qemu-system-data_1%3a4.2-3ubuntu6.17_all.deb ...\r\nUnpacking qemu-system-data (1:4.2-3ubuntu6.17) over (1:4.2-3ubuntu6.14) ...\r\nPreparing to unpack .../6-qemu-system-gui_1%3a4.2-3ubuntu6.17_amd64.deb ...\r\nUnpacking qemu-system-gui:amd64 2021-07-26T15:31:59.510 INFO:teuthology.task.ansible.out: (1:4.2-3ubuntu6.17) over (1:4.2-3ubuntu6.14) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../7-qemu-system-x86_1%3a4.2-3ubuntu6.17_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.17) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../8-qemu-utils_1%3a4.2-3ubuntu6.17_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.17) ...\r\nSetting up librados2 (15.2.13-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.17) ...\r\nSetting up git (1:2.25.1-1ubuntu3.1) ...\r\nSetting up librbd1 (15.2.13-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-data (1:4.2-3ubuntu6.17) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.17) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.17) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.17) ...\r\nProcessing triggers for hicolor-icon-theme (0.17-2) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for mime-support (3.64ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data", " qemu-system-gui qemu-utils", "Suggested packages:", " git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk", " gitweb git-cvs git-mediawiki git-svn samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "The following packages will be upgraded:", " git qemu-system-data qemu-system-gui", "3 upgraded, 6 newly installed, 0 to remove and 144 not upgraded.", "Need to get 18.8 MB of archives.", "After this operation, 62.7 MB of additional disk space will be used.", "Get:1 http://archive. 2021-07-26T15:31:59.510 INFO:teuthology.task.ansible.out:ubuntu.com/ubuntu focal-updates/main amd64 git amd64 1:2.25.1-1ubuntu3.1 [4557 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.13-0ubuntu0.20.04.1 [3212 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.13-0ubuntu0.20.04.1 [1623 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.17 [54.4 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.17 [1055 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.17 [563 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.17 [41.2 kB]", "Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.17 [6738 kB]", "Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.17 [973 kB]", "Fetched 18.8 MB in 2s (10.0 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138039 files and directories currently installed.)", "Preparing to unpack .../0-git_1%3a2.25.1-1ubuntu3.1_amd64.deb ...", "Unpacking git (1:2.25.1-1ubuntu3.1) over (1:2.25.1-1ubuntu3) ...", "Selecting previously unselected package librados2.", "Preparin 2021-07-26T15:31:59.511 INFO:teuthology.task.ansible.out:g to unpack .../1-librados2_15.2.13-0ubuntu0.20.04.1_amd64.deb . 2021-07-26T15:31:59.513 INFO:teuthology.task.ansible.out:..", "Unpacking librados2 (15.2.13-0ubuntu0.20.04.1) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../2-librbd1_15.2.13-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librbd1 (15.2.13-0ubuntu0.20.04.1) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../3-qemu-block-extra_1%3a4.2-3ubuntu6.17_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../4-qemu-system-common_1%3a4.2-3ubuntu6.17_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.17) ...", "Preparing to unpack .../5-qemu-system-data_1%3a4.2-3ubuntu6.17_all.deb ...", "Unpacking qemu-system-data (1:4.2-3ubuntu6.17) over (1:4.2-3ubuntu6.14) ...", "Preparing to unpack .../6-qemu-system-gui_1%3a4.2-3ubuntu6.17_amd64.deb ...", "Unpacking qemu-system-gui:amd64 (1:4.2-3ubuntu6.17) over (1:4.2-3ubuntu6.14) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../7-qemu-system-x86_1%3a4.2-3ubuntu6.17_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.17) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../8-qemu-utils_1%3a4.2-3ubuntu6.17_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.17) ...", "Setting up librados2 (15.2.13-0ubuntu0.20.04.1) ...", "Setting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.17) ...", "Setting up git (1:2.25.1-1ubuntu3.1) ...", "Setting up librbd1 (15.2.13-0ubuntu0.20.04.1) ...", "Setting up qemu-system-data (1:4.2-3ubuntu6.17) ...", "Setting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.17) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.17) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.17) ...", "Processing triggers for hicolor-icon-theme (0.17-2) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing 2021-07-26T15:31:59.515 INFO:teuthology.task.ansible.out: triggers for mime-support (3.64ubuntu1) ..."]} 2021-07-26T15:31:59.535 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:59 +0000 (0:00:00.721) 0:02:37.090 *********** 2021-07-26T15:31:59.541 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-07-26T15:31:59.543 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => {"cache_update_time": 1627313442, "cache_updated": false, "changed": false} 2021-07-26T15:31:59.568 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:31:59 +0000 (0:00:00.033) 0:02:37.123 *********** 2021-07-26T15:32:00.239 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"cache_update_time": 1627313442, "cache_updated": false, "changed": false} 2021-07-26T15:32:00.262 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:00 +0000 (0:00:00.693) 0:02:37.817 *********** 2021-07-26T15:32:00.269 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** 2021-07-26T15:32:00.271 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => {"cache_update_time": 1627313442, "cache_updated": false, "changed": false} 2021-07-26T15:32:00.296 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:00 +0000 (0:00:00.033) 0:02:37.851 *********** 2021-07-26T15:32:00.468 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-07-26T15:32:00.470 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-07-26T15:32:00.492 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:00 +0000 (0:00:00.196) 0:02:38.047 *********** 2021-07-26T15:32:00.560 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-07-26T15:32:00.562 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:00.583 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:00 +0000 (0:00:00.091) 0:02:38.139 *********** 2021-07-26T15:32:00.777 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-07-26T15:32:00.778 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-07-26T15:32:00.800 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:00 +0000 (0:00:00.216) 0:02:38.355 *********** 2021-07-26T15:32:00.971 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** 2021-07-26T15:32:00.973 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"cache_update_time": 1627313442, "cache_updated": false, "changed": false} 2021-07-26T15:32:00.995 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:00 +0000 (0:00:00.194) 0:02:38.550 *********** 2021-07-26T15:32:01.187 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-07-26T15:32:01.189 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-07-26T15:32:01.211 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:01 +0000 (0:00:00.216) 0:02:38.766 *********** 2021-07-26T15:32:01.217 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-07-26T15:32:01.219 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-07-26T15:32:01.245 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:01 +0000 (0:00:00.033) 0:02:38.800 *********** 2021-07-26T15:32:01.283 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-07-26T15:32:01.285 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:01.308 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:01 +0000 (0:00:00.063) 0:02:38.863 *********** 2021-07-26T15:32:01.459 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-07-26T15:32:01.461 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-07-26T15:32:01.484 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:01 +0000 (0:00:00.176) 0:02:39.040 *********** 2021-07-26T15:32:01.502 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-07-26T15:32:01.504 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-07-26T15:32:01.530 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:01 +0000 (0:00:00.045) 0:02:39.085 *********** 2021-07-26T15:32:01.662 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-07-26T15:32:01.664 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-07-26T15:32:01.686 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:01 +0000 (0:00:00.156) 0:02:39.241 *********** 2021-07-26T15:32:01.921 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-07-26T15:32:01.923 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-07-26T15:32:01.947 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:01 +0000 (0:00:00.260) 0:02:39.502 *********** 2021-07-26T15:32:01.997 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-07-26T15:32:01.998 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Mon 2021-07-26 15:31:37 UTC", "ActiveEnterTimestampMonotonic": "157589907", "ActiveExitTimestamp": "Mon 2021-07-26 15:31:37 UTC", "ActiveExitTimestampMonotonic": "157505387", "ActiveState": "active", "After": "nss-lookup.target network.target system.slice sysinit.target basic.target -.mount systemd-tmpfiles-setup.service systemd-journald.socket remote-fs.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-07-26 15:31:37 UTC", "AssertTimestampMonotonic": "157556956", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-07-26 15:31:37 UTC", "ConditionTimestampMonotonic": "157556955", "ConfigurationDirec 2021-07-26T15:32:02.000 INFO:teuthology.task.ansible.out:toryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "6523", "ExecMainStartTimestamp": "Mon 2021-07-26 15:31:37 UTC", "ExecMainStartTimestampMonotonic": "157589880", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPrior 2021-07-26T15:32:02.002 INFO:teuthology.task.ansible.out:ity": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Mon 2021-07-26 15:31:37 UTC", "InactiveEnterTimestampMonotonic": "157555470", "InactiveExitTimestamp": "Mon 2021-07-26 15:31:37 UTC", "InactiveExitTimestampMonotonic": "157559582", "InvocationID": "1c70b812429442ae9ebdbeca89afc7f0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127777", "LimitNPROCSoft": "127777", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127777", "LimitSIGPENDINGSoft": "127777", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "6523", "MemoryAccounting": "yes", "MemoryCurrent": "6672384", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemoryS 2021-07-26T15:32:02.003 INFO:teuthology.task.ansible.out:wapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-07-26 15:31:37 UTC", "StateChangeTimestampMonotonic": "157589907", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", " 2021-07-26T15:32:02.005 INFO:teuthology.task.ansible.out:TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38333", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-07-26T15:32:02.024 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:02 +0000 (0:00:00.076) 0:02:39.579 *********** 2021-07-26T15:32:02.092 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:02.115 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:02 +0000 (0:00:00.091) 0:02:39.670 *********** 2021-07-26T15:32:02.164 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-07-26T15:32:02.166 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-07-26T15:32:02.189 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:02 +0000 (0:00:00.073) 0:02:39.744 *********** 2021-07-26T15:32:02.194 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-07-26T15:32:02.196 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:02.220 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:02 +0000 (0:00:00.031) 0:02:39.775 *********** 2021-07-26T15:32:02.289 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-07-26T15:32:02.290 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:02.312 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:02 +0000 (0:00:00.091) 0:02:39.867 *********** 2021-07-26T15:32:02.369 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-07-26T15:32:02.371 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-07-26T15:32:02.394 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:02 +0000 (0:00:00.081) 0:02:39.949 *********** 2021-07-26T15:32:02.400 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-07-26T15:32:02.402 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:02.426 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:02 +0000 (0:00:00.031) 0:02:39.981 *********** 2021-07-26T15:32:02.496 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-07-26T15:32:02.498 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:02.523 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:02 +0000 (0:00:00.097) 0:02:40.078 *********** 2021-07-26T15:32:02.592 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-07-26T15:32:02.594 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:02.615 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:02 +0000 (0:00:00.092) 0:02:40.171 *********** 2021-07-26T15:32:02.684 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-07-26T15:32:02.686 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:02.708 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:02 +0000 (0:00:00.092) 0:02:40.263 *********** 2021-07-26T15:32:02.715 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-07-26T15:32:02.717 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Mon 2021-07-26 15:31:37 UTC", "ActiveEnterTimestampMonotonic": "235856917", "ActiveExitTimestamp": "Mon 2021-07-26 15:31:37 UTC", "ActiveExitTimestampMonotonic": "235775690", "ActiveState": "active", "After": "-.mount sysinit.target systemd-tmpfiles-setup.service systemd-journald.socket system.slice nss-lookup.target remote-fs.target basic.target network.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-07-26 15:31:37 UTC", "AssertTimestampMonotonic": "235825951", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-07-26 15:31:37 UTC", "ConditionTimestampMonotonic": "235825950", "ConfigurationDirec 2021-07-26T15:32:02.718 INFO:teuthology.task.ansible.out:toryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "6546", "ExecMainStartTimestamp": "Mon 2021-07-26 15:31:37 UTC", "ExecMainStartTimestampMonotonic": "235856901", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPrior 2021-07-26T15:32:02.720 INFO:teuthology.task.ansible.out:ity": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Mon 2021-07-26 15:31:37 UTC", "InactiveEnterTimestampMonotonic": "235824559", "InactiveExitTimestamp": "Mon 2021-07-26 15:31:37 UTC", "InactiveExitTimestampMonotonic": "235828254", "InvocationID": "307d1adc4616472ba52c872142b716c0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127777", "LimitNPROCSoft": "127777", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127777", "LimitSIGPENDINGSoft": "127777", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "6546", "MemoryAccounting": "yes", "MemoryCurrent": "6701056", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemoryS 2021-07-26T15:32:02.722 INFO:teuthology.task.ansible.out:wapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-07-26 15:31:37 UTC", "StateChangeTimestampMonotonic": "235856917", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", " 2021-07-26T15:32:02.724 INFO:teuthology.task.ansible.out:TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38333", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-07-26T15:32:02.744 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:02 +0000 (0:00:00.036) 0:02:40.299 *********** 2021-07-26T15:32:02.771 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-07-26T15:32:02.773 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:02.796 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:02 +0000 (0:00:00.052) 0:02:40.351 *********** 2021-07-26T15:32:02.814 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:02.838 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:02 +0000 (0:00:00.041) 0:02:40.393 *********** 2021-07-26T15:32:02.865 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-07-26T15:32:02.867 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:02.891 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:02 +0000 (0:00:00.052) 0:02:40.445 *********** 2021-07-26T15:32:02.907 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-07-26T15:32:02.909 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:02.932 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:02 +0000 (0:00:00.041) 0:02:40.487 *********** 2021-07-26T15:32:02.959 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-07-26T15:32:02.960 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:02.983 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:02 +0000 (0:00:00.051) 0:02:40.538 *********** 2021-07-26T15:32:03.000 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-07-26T15:32:03.001 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:03.025 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:03 +0000 (0:00:00.041) 0:02:40.580 *********** 2021-07-26T15:32:03.056 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-07-26T15:32:03.058 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:03.080 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:03 +0000 (0:00:00.055) 0:02:40.635 *********** 2021-07-26T15:32:03.097 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-07-26T15:32:03.099 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:03.125 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:03 +0000 (0:00:00.045) 0:02:40.681 *********** 2021-07-26T15:32:03.153 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-07-26T15:32:03.156 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:03.178 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:03 +0000 (0:00:00.052) 0:02:40.733 *********** 2021-07-26T15:32:03.195 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-07-26T15:32:03.197 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:03.220 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:03 +0000 (0:00:00.042) 0:02:40.775 *********** 2021-07-26T15:32:03.248 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-07-26T15:32:03.250 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:03.273 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:03 +0000 (0:00:00.052) 0:02:40.828 *********** 2021-07-26T15:32:03.290 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-07-26T15:32:03.291 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:03.315 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:03 +0000 (0:00:00.042) 0:02:40.870 *********** 2021-07-26T15:32:03.342 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-07-26T15:32:03.344 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:03.367 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:03 +0000 (0:00:00.052) 0:02:40.922 *********** 2021-07-26T15:32:03.384 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-07-26T15:32:03.386 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:03.412 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:03 +0000 (0:00:00.044) 0:02:40.967 *********** 2021-07-26T15:32:03.414 INFO:teuthology.task.ansible.out: 2021-07-26T15:32:03.442 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:03.467 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:03 +0000 (0:00:00.054) 0:02:41.022 *********** 2021-07-26T15:32:03.484 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-07-26T15:32:03.486 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:03.509 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:03 +0000 (0:00:00.042) 0:02:41.064 *********** 2021-07-26T15:32:03.537 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-07-26T15:32:03.539 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:03.566 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:03 +0000 (0:00:00.056) 0:02:41.121 *********** 2021-07-26T15:32:03.585 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:03.616 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:03 +0000 (0:00:00.048) 0:02:41.170 *********** 2021-07-26T15:32:03.642 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-07-26T15:32:03.644 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:03.668 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:03 +0000 (0:00:00.053) 0:02:41.223 *********** 2021-07-26T15:32:03.686 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-07-26T15:32:03.688 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:03.718 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:03 +0000 (0:00:00.050) 0:02:41.273 *********** 2021-07-26T15:32:03.747 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-07-26T15:32:03.748 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:03.774 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:03 +0000 (0:00:00.055) 0:02:41.329 *********** 2021-07-26T15:32:03.794 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-07-26T15:32:03.796 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:03.835 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:03 +0000 (0:00:00.061) 0:02:41.390 *********** 2021-07-26T15:32:03.854 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-07-26T15:32:03.857 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:03.882 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:03 +0000 (0:00:00.047) 0:02:41.437 *********** 2021-07-26T15:32:03.913 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:03.946 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:03 +0000 (0:00:00.064) 0:02:41.502 *********** 2021-07-26T15:32:03.964 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-07-26T15:32:03.966 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:03.989 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:03 +0000 (0:00:00.042) 0:02:41.545 *********** 2021-07-26T15:32:04.019 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-07-26T15:32:04.021 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:04.044 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:04 +0000 (0:00:00.054) 0:02:41.599 *********** 2021-07-26T15:32:04.061 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-07-26T15:32:04.063 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:04.088 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:04 +0000 (0:00:00.044) 0:02:41.643 *********** 2021-07-26T15:32:04.117 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-07-26T15:32:04.119 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:04.143 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:04 +0000 (0:00:00.054) 0:02:41.698 *********** 2021-07-26T15:32:04.171 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-07-26T15:32:04.173 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:04.197 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:04 +0000 (0:00:00.053) 0:02:41.752 *********** 2021-07-26T15:32:04.214 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-07-26T15:32:04.216 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:04.239 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:04 +0000 (0:00:00.042) 0:02:41.795 *********** 2021-07-26T15:32:04.278 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-07-26T15:32:04.279 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:04.302 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:04 +0000 (0:00:00.061) 0:02:41.856 *********** 2021-07-26T15:32:04.318 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-07-26T15:32:04.320 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:04.346 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:04 +0000 (0:00:00.045) 0:02:41.901 *********** 2021-07-26T15:32:04.373 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-07-26T15:32:04.375 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:04.398 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:04 +0000 (0:00:00.051) 0:02:41.953 *********** 2021-07-26T15:32:04.414 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-07-26T15:32:04.416 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:04.439 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:04 +0000 (0:00:00.041) 0:02:41.995 *********** 2021-07-26T15:32:04.466 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:04.491 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:04 +0000 (0:00:00.051) 0:02:42.046 *********** 2021-07-26T15:32:04.508 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-07-26T15:32:04.510 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:04.534 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:04 +0000 (0:00:00.042) 0:02:42.089 *********** 2021-07-26T15:32:04.561 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:04.585 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:04 +0000 (0:00:00.051) 0:02:42.140 *********** 2021-07-26T15:32:04.602 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-07-26T15:32:04.604 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:04.627 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:04 +0000 (0:00:00.041) 0:02:42.182 *********** 2021-07-26T15:32:04.697 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:04.721 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:04 +0000 (0:00:00.093) 0:02:42.276 *********** 2021-07-26T15:32:04.768 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-07-26T15:32:04.770 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-07-26T15:32:04.793 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:04 +0000 (0:00:00.072) 0:02:42.348 *********** 2021-07-26T15:32:04.800 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-07-26T15:32:04.802 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:04.825 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:04 +0000 (0:00:00.032) 0:02:42.381 *********** 2021-07-26T15:32:04.905 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:04.929 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:04 +0000 (0:00:00.103) 0:02:42.484 *********** 2021-07-26T15:32:04.997 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-07-26T15:32:04.999 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:05.019 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:05 +0000 (0:00:00.090) 0:02:42.575 *********** 2021-07-26T15:32:05.099 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-07-26T15:32:05.101 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:05.126 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:05 +0000 (0:00:00.106) 0:02:42.681 *********** 2021-07-26T15:32:05.174 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-07-26T15:32:05.176 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-07-26T15:32:05.199 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:05 +0000 (0:00:00.073) 0:02:42.755 *********** 2021-07-26T15:32:05.218 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-07-26T15:32:05.219 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:05.243 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:05 +0000 (0:00:00.044) 0:02:42.799 *********** 2021-07-26T15:32:05.272 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-07-26T15:32:05.274 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:05.297 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:05 +0000 (0:00:00.053) 0:02:42.852 *********** 2021-07-26T15:32:05.314 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-07-26T15:32:05.316 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:05.341 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:05 +0000 (0:00:00.044) 0:02:42.896 *********** 2021-07-26T15:32:05.525 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-07-26T15:32:05.527 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-07-26T15:32:05.549 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:05 +0000 (0:00:00.207) 0:02:43.104 *********** 2021-07-26T15:32:05.669 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-07-26T15:32:05.671 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-07-26T15:32:05.693 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:05 +0000 (0:00:00.144) 0:02:43.249 *********** 2021-07-26T15:32:05.910 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-07-26T15:32:05.912 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-07-26T15:32:05.934 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:05 +0000 (0:00:00.240) 0:02:43.490 *********** 2021-07-26T15:32:06.003 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-07-26T15:32:06.004 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:06.026 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:06 +0000 (0:00:00.091) 0:02:43.581 *********** 2021-07-26T15:32:06.073 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-07-26T15:32:06.075 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-07-26T15:32:06.098 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:06 +0000 (0:00:00.071) 0:02:43.653 *********** 2021-07-26T15:32:06.408 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-07-26T15:32:06.410 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-07-26T15:32:06.436 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:06 +0000 (0:00:00.338) 0:02:43.991 *********** 2021-07-26T15:32:06.475 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-07-26T15:32:06.477 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-07-26T15:32:06.501 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:06 +0000 (0:00:00.065) 0:02:44.056 *********** 2021-07-26T15:32:06.685 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-07-26T15:32:06.687 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-07-26T15:32:06.708 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:06 +0000 (0:00:00.206) 0:02:44.263 *********** 2021-07-26T15:32:06.777 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-07-26T15:32:06.778 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:06.800 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:06 +0000 (0:00:00.092) 0:02:44.355 *********** 2021-07-26T15:32:06.817 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-07-26T15:32:06.819 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-07-26T15:32:06.843 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:06 +0000 (0:00:00.042) 0:02:44.398 *********** 2021-07-26T15:32:06.870 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-07-26T15:32:06.872 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:06.895 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:06 +0000 (0:00:00.052) 0:02:44.451 *********** 2021-07-26T15:32:06.964 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-07-26T15:32:06.966 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:06.987 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:06 +0000 (0:00:00.091) 0:02:44.543 *********** 2021-07-26T15:32:07.067 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-07-26T15:32:07.069 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:07.092 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:07 +0000 (0:00:00.104) 0:02:44.647 *********** 2021-07-26T15:32:07.161 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-07-26T15:32:07.163 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:07.184 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:07 +0000 (0:00:00.091) 0:02:44.739 *********** 2021-07-26T15:32:07.222 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-07-26T15:32:07.247 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:07 +0000 (0:00:00.062) 0:02:44.802 *********** 2021-07-26T15:32:07.264 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-07-26T15:32:07.266 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-07-26T15:32:07.289 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:07 +0000 (0:00:00.041) 0:02:44.844 *********** 2021-07-26T15:32:07.389 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-07-26T15:32:07.391 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-07-26T15:32:07.401 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-07-26T15:32:07.402 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-07-26T15:32:07.412 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-07-26T15:32:07.413 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-07-26T15:32:07.424 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-07-26T15:32:07.426 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** ok: [smithi197.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-07-26T15:32:07.448 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:07 +0000 (0:00:00.159) 0:02:45.003 *********** 2021-07-26T15:32:07.455 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-07-26T15:32:07.457 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-07-26T15:32:07.468 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2021-07-26T15:32:07.470 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2021-07-26T15:32:07.480 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-07-26T15:32:07.512 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:07 +0000 (0:00:00.063) 0:02:45.067 *********** 2021-07-26T15:32:07.529 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:07.555 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:07 +0000 (0:00:00.043) 0:02:45.110 *********** 2021-07-26T15:32:07.624 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-07-26T15:32:07.625 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:07.648 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:07 +0000 (0:00:00.093) 0:02:45.203 *********** 2021-07-26T15:32:07.718 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:07.743 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:07 +0000 (0:00:00.094) 0:02:45.298 *********** 2021-07-26T15:32:07.749 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-07-26T15:32:07.751 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.002992", "end": "2021-07-26 15:32:07.723170", "rc": 0, "start": "2021-07-26 15:32:07.720178", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_b6f3efab84b70e18e86ec271a07564aeb4ed3bac/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_b6f3efab84b70e18e86ec271a07564aeb4ed3bac/virtualenv/bin/teuthology-lock"]} 2021-07-26T15:32:07.779 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:07 +0000 (0:00:00.035) 0:02:45.334 *********** 2021-07-26T15:32:07.807 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-07-26T15:32:07.809 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:07.834 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:07 +0000 (0:00:00.054) 0:02:45.389 *********** 2021-07-26T15:32:07.851 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:07.879 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:07 +0000 (0:00:00.045) 0:02:45.434 *********** 2021-07-26T15:32:07.907 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:07.932 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:07 +0000 (0:00:00.052) 0:02:45.487 *********** 2021-07-26T15:32:07.949 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-07-26T15:32:07.950 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:07.974 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:07 +0000 (0:00:00.042) 0:02:45.529 *********** 2021-07-26T15:32:08.001 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-07-26T15:32:08.003 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-07-26T15:32:08.026 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:08 +0000 (0:00:00.052) 0:02:45.581 *********** 2021-07-26T15:32:08.053 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-07-26T15:32:08.054 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:08.077 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:08 +0000 (0:00:00.050) 0:02:45.632 *********** 2021-07-26T15:32:08.104 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-07-26T15:32:08.105 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2021-07-26T15:32:08.115 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-07-26T15:32:08.117 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-07-26T15:32:08.126 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-07-26T15:32:08.128 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-07-26T15:32:08.138 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-07-26T15:32:08.140 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-07-26T15:32:08.149 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-07-26T15:32:08.151 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2021-07-26T15:32:08.161 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-07-26T15:32:08.162 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-07-26T15:32:08.172 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2021-07-26T15:32:08.174 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-07-26T15:32:08.183 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2021-07-26T15:32:08.185 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-07-26T15:32:08.213 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:08 +0000 (0:00:00.135) 0:02:45.768 *********** 2021-07-26T15:32:08.447 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-07-26T15:32:08.449 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.002985", "end": "2021-07-26 15:32:08.422148", "rc": 0, "start": "2021-07-26 15:32:08.419163", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_b6f3efab84b70e18e86ec271a07564aeb4ed3bac/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_b6f3efab84b70e18e86ec271a07564aeb4ed3bac/virtualenv/bin/teuthology-lock"]} 2021-07-26T15:32:08.478 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:08 +0000 (0:00:00.265) 0:02:46.033 *********** 2021-07-26T15:32:08.547 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-07-26T15:32:08.548 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:08.572 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:08 +0000 (0:00:00.094) 0:02:46.128 *********** 2021-07-26T15:32:08.641 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-07-26T15:32:08.643 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:08.665 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:08 +0000 (0:00:00.092) 0:02:46.220 *********** 2021-07-26T15:32:08.734 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-07-26T15:32:08.736 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:08.758 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:08 +0000 (0:00:00.092) 0:02:46.312 *********** 2021-07-26T15:32:08.784 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-07-26T15:32:08.786 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => {"cache_update_time": 1627313442, "cache_updated": false, "changed": false} 2021-07-26T15:32:08.810 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:08 +0000 (0:00:00.052) 0:02:46.364 *********** 2021-07-26T15:32:08.880 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:08.903 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:08 +0000 (0:00:00.093) 0:02:46.458 *********** 2021-07-26T15:32:08.982 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-07-26T15:32:08.984 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item={'block_used': 13859358, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226235750, 'size_available': 926661632000, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 150120, 'block_size': 4096, 'inode_available': 60904856}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226235750, "block_size": 4096, "block_total": 240095108, "block_used": 13859358, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60904856, "inode_total": 61054976, "inode_used": 150120, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926661632000, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}} 2021-07-26T15:32:09.007 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:09 +0000 (0:00:00.103) 0:02:46.562 *********** 2021-07-26T15:32:09.203 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-07-26T15:32:09.204 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.009294", "end": "2021-07-26 15:32:09.654016", "rc": 0, "start": "2021-07-26 15:32:09.644722", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:32:09.226 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:09 +0000 (0:00:00.219) 0:02:46.781 *********** 2021-07-26T15:32:09.306 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-07-26T15:32:09.308 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'block_used': 13859358, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226235750, 'size_available': 926661632000, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 150120, 'block_size': 4096, 'inode_available': 60904856}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226235750, "block_size": 4096, "block_total": 240095108, "block_used": 13859358, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60904856, "inode_total": 61054976, "inode_used": 150120, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926661632000, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:09.330 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:09 +0000 (0:00:00.104) 0:02:46.886 *********** 2021-07-26T15:32:09.399 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-07-26T15:32:09.422 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:09 +0000 (0:00:00.091) 0:02:46.977 *********** 2021-07-26T15:32:09.458 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-07-26T15:32:09.460 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"cache_update_time": 1627313442, "cache_updated": false, "changed": false} 2021-07-26T15:32:09.483 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:09 +0000 (0:00:00.060) 0:02:47.038 *********** 2021-07-26T15:32:09.510 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-07-26T15:32:09.513 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:09.553 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:09.580 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:09 +0000 (0:00:00.097) 0:02:47.135 *********** 2021-07-26T15:32:09.658 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-07-26T15:32:09.660 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item={'block_used': 13859375, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226235733, 'size_available': 926661562368, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 150120, 'block_size': 4096, 'inode_available': 60904856}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226235733, "block_size": 4096, "block_total": 240095108, "block_used": 13859375, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60904856, "inode_total": 61054976, "inode_used": 150120, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926661562368, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}} 2021-07-26T15:32:09.682 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:09 +0000 (0:00:00.101) 0:02:47.237 *********** 2021-07-26T15:32:09.875 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** changed: [smithi197.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.009470", "end": "2021-07-26 15:32:09.847349", "rc": 0, "start": "2021-07-26 15:32:09.837879", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:32:09.899 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:09 +0000 (0:00:00.216) 0:02:47.454 *********** 2021-07-26T15:32:09.978 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-07-26T15:32:09.980 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'block_used': 13859375, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226235733, 'size_available': 926661562368, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 150120, 'block_size': 4096, 'inode_available': 60904856}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226235733, "block_size": 4096, "block_total": 240095108, "block_used": 13859375, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60904856, "inode_total": 61054976, "inode_used": 150120, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926661562368, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:10.003 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:10 +0000 (0:00:00.104) 0:02:47.558 *********** 2021-07-26T15:32:10.073 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-07-26T15:32:10.096 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:10 +0000 (0:00:00.093) 0:02:47.651 *********** 2021-07-26T15:32:10.197 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-07-26T15:32:10.198 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:11.256 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-xbDm37yVqcdD2Tttee3JxjkyPazVRkdzRuepXRXLpmsWIo4XGfL3YTke40oHQNwm'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.611003", "end": "2021-07-26 15:32:11.697948", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-xbDm37yVqcdD2Tttee3JxjkyPazVRkdzRuepXRXLpmsWIo4XGfL3YTke40oHQNwm"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:32:10.086945", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-07-26T15:32:11.257 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:11.268 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:11.952 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-RcRvanhE8TM2GI30ssMjqCO4WmKn6yFUO1sZryoLy96cybHpyw5g0HBZv7CTVdmo'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.624503", "end": "2021-07-26 15:32:11.920489", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-RcRvanhE8TM2GI30ssMjqCO4WmKn6yFUO1sZryoLy96cybHpyw5g0HBZv7CTVdmo"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:32:10.295986", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-07-26T15:32:11.953 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:11.964 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:12.515 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-xbDm37yVqcdD2Tttee3JxjkyPazVRkdz9iBNc2F7iZUdhABbsBVRSaHwO1xAmwuc'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.112994", "end": "2021-07-26 15:32:12.955926", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-xbDm37yVqcdD2Tttee3JxjkyPazVRkdz9iBNc2F7iZUdhABbsBVRSaHwO1xAmwuc"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:32:11.842932", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-07-26T15:32:12.516 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XFFN', 'wwn-0x5000c50092929219'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XFFN-part1', 'wwn-0x5000c50092929219-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50092929219', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5XFFN', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFFN", "wwn-0x5000c50092929219"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFFN-part1", "wwn-0x5000c50092929219-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XFFN", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50092929219"}}, 2021-07-26T15:32:12.518 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2021-07-26T15:32:13.234 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-RcRvanhE8TM2GI30ssMjqCO4WmKn6yFUDhc3885wmrI1kSYYxnJjVrjpqi9oeW2v'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.138819", "end": "2021-07-26 15:32:13.199790", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-RcRvanhE8TM2GI30ssMjqCO4WmKn6yFUDhc3885wmrI1kSYYxnJjVrjpqi9oeW2v"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:32:12.060971", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-07-26T15:32:13.235 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XK3R', 'wwn-0x5000c5009293d217'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XK3R-part1', 'wwn-0x5000c5009293d217-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c5009293d217', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5XK3R', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XK3R", "wwn-0x5000c5009293d217"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XK3R-part1", "wwn-0x5000c5009293d217-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XK3R", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c5009293d217"}}, 2021-07-26T15:32:13.237 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2021-07-26T15:32:13.816 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-Cq0Qh1-9mI2-5Dgi-WzRE-xT5o-sg5d-Stw1vY', 'nvme-INTEL_SSDPEDMD400G4_PHFT620500QJ400BGN', 'nvme-nvme.8086-50484654363230353030514a34303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.173416", "end": "2021-07-26 15:32:14.265254", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-Cq0Qh1-9mI2-5Dgi-WzRE-xT5o-sg5d-Stw1vY", "nvme-INTEL_SSDPEDMD400G4_PHFT620500QJ400BGN", "nvme-nvme.8086-50484654363230353030514a34303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:32:13.091838", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures d 2021-07-26T15:32:13.818 INFO:teuthology.task.ansible.out:estroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-07-26T15:32:13.828 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:13.839 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:14.512 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-5keHSB-dZLW-QMjb-6Dpv-G8aJ-PxB2-rpvdXw', 'nvme-INTEL_SSDPEDMD400G4_PHFT620500HG400BGN', 'nvme-nvme.8086-50484654363230353030484734303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.143845", "end": "2021-07-26 15:32:14.478316", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-5keHSB-dZLW-QMjb-6Dpv-G8aJ-PxB2-rpvdXw", "nvme-INTEL_SSDPEDMD400G4_PHFT620500HG400BGN", "nvme-nvme.8086-50484654363230353030484734303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:32:13.334471", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures d 2021-07-26T15:32:14.514 INFO:teuthology.task.ansible.out:estroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} skipping: [smithi197.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:14.524 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:15.096 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-xbDm37yVqcdD2Tttee3JxjkyPazVRkdzS1TILR3rCn3J14sCAV3jteZBqOFTjL6P'], 'uuids': ['275985d9-7ed1-46f2-81dd-abec42d9b9ac']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.133870", "end": "2021-07-26 15:32:15.539408", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-xbDm37yVqcdD2Tttee3JxjkyPazVRkdzS1TILR3rCn3J14sCAV3jteZBqOFTjL6P"], "labels": [], "masters": [], "uuids": ["275985d9-7ed1-46f2-81dd-abec42d9b9ac"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:32:14.405538", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-07-26T15:32:15.107 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:15.108 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:15.782 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-RcRvanhE8TM2GI30ssMjqCO4WmKn6yFUWQBriO4vgA2kWeN44NF5Fcr522WpEUIO'], 'uuids': ['1ff2c25f-61f2-4a2b-9796-9d407590eeac']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.131077", "end": "2021-07-26 15:32:15.754313", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-RcRvanhE8TM2GI30ssMjqCO4WmKn6yFUWQBriO4vgA2kWeN44NF5Fcr522WpEUIO"], "labels": [], "masters": [], "uuids": ["1ff2c25f-61f2-4a2b-9796-9d407590eeac"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:32:14.623236", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-07-26T15:32:15.794 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:15.805 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:16.349 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-xbDm37yVqcdD2Tttee3JxjkyPazVRkdzoXQ3AGKo6TPNTzZRRI46a9lpLI5Xsiuh'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.114049", "end": "2021-07-26 15:32:16.797855", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-xbDm37yVqcdD2Tttee3JxjkyPazVRkdzoXQ3AGKo6TPNTzZRRI46a9lpLI5Xsiuh"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:32:15.683806", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-07-26T15:32:16.361 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:17.063 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-RcRvanhE8TM2GI30ssMjqCO4WmKn6yFU3e5X4ADUXzP6nSUda0XRQFIEU8PvYqaA'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.136539", "end": "2021-07-26 15:32:17.034197", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-RcRvanhE8TM2GI30ssMjqCO4WmKn6yFU3e5X4ADUXzP6nSUda0XRQFIEU8PvYqaA"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:32:15.897658", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-07-26T15:32:17.074 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:17.617 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-xbDm37yVqcdD2Tttee3JxjkyPazVRkdzWVyuw4hRGXqAwuPg7e5g6zxlNEgKZkAd'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.123928", "end": "2021-07-26 15:32:18.056347", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-xbDm37yVqcdD2Tttee3JxjkyPazVRkdzWVyuw4hRGXqAwuPg7e5g6zxlNEgKZkAd"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:32:16.932419", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-07-26T15:32:17.651 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:17 +0000 (0:00:07.554) 0:02:55.206 *********** 2021-07-26T15:32:17.743 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-07-26T15:32:17.832 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:18.040 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-xbDm37yVqcdD2Tttee3JxjkyPazVRkdzRuepXRXLpmsWIo4XGfL3YTke40oHQNwm'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.161316", "end": "2021-07-26 15:32:18.483841", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-xbDm37yVqcdD2Tttee3JxjkyPazVRkdzRuepXRXLpmsWIo4XGfL3YTke40oHQNwm"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:32:18.322525", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.156463 s, 737 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.156463 s, 737 MB/s"], "stdout": "", "stdout_lines": []} 2021-07-26T15:32:18.052 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:18.053 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:18.313 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-07-26T15:32:18.314 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-RcRvanhE8TM2GI30ssMjqCO4WmKn6yFUQInw1MDsfvND5k80HTY6OeXcv46cdJh5'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.112694", "end": "2021-07-26 15:32:18.284023", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-RcRvanhE8TM2GI30ssMjqCO4WmKn6yFUQInw1MDsfvND5k80HTY6OeXcv46cdJh5"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:32:17.171329", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-07-26T15:32:18.347 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:18 +0000 (0:00:00.695) 0:02:55.902 *********** 2021-07-26T15:32:18.364 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-07-26T15:32:18.366 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-xbDm37yVqcdD2Tttee3JxjkyPazVRkdz9iBNc2F7iZUdhABbsBVRSaHwO1xAmwuc'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.171471", "end": "2021-07-26 15:32:18.806455", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-xbDm37yVqcdD2Tttee3JxjkyPazVRkdz9iBNc2F7iZUdhABbsBVRSaHwO1xAmwuc"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:32:18.634984", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.166678 s, 692 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.166678 s, 692 MB/s"], "stdout": "", "stdout_lines": []} 2021-07-26T15:32:18.367 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XFFN', 'wwn-0x5000c50092929219'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XFFN-part1', 'wwn-0x5000c5 2021-07-26T15:32:18.368 INFO:teuthology.task.ansible.out:0092929219-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50092929219', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5XFFN', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFFN", "wwn-0x5000c50092929219"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFFN-part1", "wwn-0x5000c50092929219-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XFFN", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50092929219"}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:18.441 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:18.557 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-Cq0Qh1-9mI2-5Dgi-WzRE-xT5o-sg5d-Stw1vY', 'nvme-INTEL_SSDPEDMD400G4_PHFT620500QJ400BGN', 'nvme-nvme.8086-50484654363230353030514a34303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.057771", "end": "2021-07-26 15:32:19.001689", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-Cq0Qh1-9mI2-5Dgi-WzRE-xT5o-sg5d-Stw1vY", "nvme-INTEL_SSDPEDMD400G4_PHFT620500QJ400BGN", "nvme-nvme.8086-50484654363230353030514a34303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:32:18.943918", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0527241 s, 2.2 GB/s", "std 2021-07-26T15:32:18.559 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0527241 s, 2.2 GB/s"], "stdout": "", "stdout_lines": []} skipping: [smithi183.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:18.570 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:18.730 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-RcRvanhE8TM2GI30ssMjqCO4WmKn6yFUO1sZryoLy96cybHpyw5g0HBZv7CTVdmo'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.172220", "end": "2021-07-26 15:32:18.707384", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-RcRvanhE8TM2GI30ssMjqCO4WmKn6yFUO1sZryoLy96cybHpyw5g0HBZv7CTVdmo"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:32:18.535164", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.167219 s, 690 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.167219 s, 690 MB/s"], "stdout": "", "stdout_lines": []} 2021-07-26T15:32:18.742 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:18.753 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:18.858 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-xbDm37yVqcdD2Tttee3JxjkyPazVRkdzS1TILR3rCn3J14sCAV3jteZBqOFTjL6P'], 'uuids': ['275985d9-7ed1-46f2-81dd-abec42d9b9ac']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.160052", "end": "2021-07-26 15:32:19.300925", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-xbDm37yVqcdD2Tttee3JxjkyPazVRkdzS1TILR3rCn3J14sCAV3jteZBqOFTjL6P"], "labels": [], "masters": [], "uuids": ["275985d9-7ed1-46f2-81dd-abec42d9b9ac"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:32:19.140873", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.155294 s, 743 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.155294 s, 743 MB/s"], "stdout": "", "stdout_lines": []} 2021-07-26T15:32:18.859 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:18.870 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:19.036 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-RcRvanhE8TM2GI30ssMjqCO4WmKn6yFUDhc3885wmrI1kSYYxnJjVrjpqi9oeW2v'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.164548", "end": "2021-07-26 15:32:19.013003", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-RcRvanhE8TM2GI30ssMjqCO4WmKn6yFUDhc3885wmrI1kSYYxnJjVrjpqi9oeW2v"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:32:18.848455", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.159654 s, 722 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.159654 s, 722 MB/s"], "stdout": "", "stdout_lines": []} 2021-07-26T15:32:19.048 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XK3R', 'wwn-0x5000c5009293d217'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XK3R-part1', 'wwn-0x5000c5009293d217-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c5009293d217', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5XK3R', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XK3R", "wwn-0x5000c5009293d217"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XK3R-part1", "wwn-0x5000c5009293d217-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XK3R", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c5009293d217"}}, 2021-07-26T15:32:19.050 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2021-07-26T15:32:19.163 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-xbDm37yVqcdD2Tttee3JxjkyPazVRkdzoXQ3AGKo6TPNTzZRRI46a9lpLI5Xsiuh'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.164040", "end": "2021-07-26 15:32:19.606282", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-xbDm37yVqcdD2Tttee3JxjkyPazVRkdzoXQ3AGKo6TPNTzZRRI46a9lpLI5Xsiuh"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:32:19.442242", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.15918 s, 725 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.15918 s, 725 MB/s"], "stdout": "", "stdout_lines": []} 2021-07-26T15:32:19.164 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:19.228 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-5keHSB-dZLW-QMjb-6Dpv-G8aJ-PxB2-rpvdXw', 'nvme-INTEL_SSDPEDMD400G4_PHFT620500HG400BGN', 'nvme-nvme.8086-50484654363230353030484734303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.059253", "end": "2021-07-26 15:32:19.204874", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-5keHSB-dZLW-QMjb-6Dpv-G8aJ-PxB2-rpvdXw", "nvme-INTEL_SSDPEDMD400G4_PHFT620500HG400BGN", "nvme-nvme.8086-50484654363230353030484734303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:32:19.145621", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0543184 s, 2.1 GB/s", "std 2021-07-26T15:32:19.230 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0543184 s, 2.1 GB/s"], "stdout": "", "stdout_lines": []} 2021-07-26T15:32:19.240 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:19.252 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:19.452 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-xbDm37yVqcdD2Tttee3JxjkyPazVRkdzWVyuw4hRGXqAwuPg7e5g6zxlNEgKZkAd'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.165325", "end": "2021-07-26 15:32:19.902260", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-xbDm37yVqcdD2Tttee3JxjkyPazVRkdzWVyuw4hRGXqAwuPg7e5g6zxlNEgKZkAd"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:32:19.736935", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.160412 s, 719 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.160412 s, 719 MB/s"], "stdout": "", "stdout_lines": []} 2021-07-26T15:32:19.496 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:19 +0000 (0:00:01.149) 0:02:57.052 *********** 2021-07-26T15:32:19.525 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-RcRvanhE8TM2GI30ssMjqCO4WmKn6yFUWQBriO4vgA2kWeN44NF5Fcr522WpEUIO'], 'uuids': ['1ff2c25f-61f2-4a2b-9796-9d407590eeac']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.154380", "end": "2021-07-26 15:32:19.496859", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-RcRvanhE8TM2GI30ssMjqCO4WmKn6yFUWQBriO4vgA2kWeN44NF5Fcr522WpEUIO"], "labels": [], "masters": [], "uuids": ["1ff2c25f-61f2-4a2b-9796-9d407590eeac"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:32:19.342479", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.149569 s, 771 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.149569 s, 771 MB/s"], "stdout": "", "stdout_lines": []} 2021-07-26T15:32:19.527 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:19.539 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:19.833 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-RcRvanhE8TM2GI30ssMjqCO4WmKn6yFU3e5X4ADUXzP6nSUda0XRQFIEU8PvYqaA'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.163216", "end": "2021-07-26 15:32:19.801260", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-RcRvanhE8TM2GI30ssMjqCO4WmKn6yFU3e5X4ADUXzP6nSUda0XRQFIEU8PvYqaA"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:32:19.638044", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.158198 s, 729 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.158198 s, 729 MB/s"], "stdout": "", "stdout_lines": []} 2021-07-26T15:32:19.834 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-07-26T15:32:19.835 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.121749", "end": "2021-07-26 15:32:20.209261", "rc": 0, "start": "2021-07-26 15:32:20.087512", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:32:19.837 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** skipping: [smithi197.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:19.859 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:19 +0000 (0:00:00.362) 0:02:57.414 *********** 2021-07-26T15:32:20.077 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-07-26T15:32:20.078 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.085471", "end": "2021-07-26 15:32:20.533863", "rc": 0, "start": "2021-07-26 15:32:20.448392", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:32:20.101 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:20 +0000 (0:00:00.242) 0:02:57.656 *********** 2021-07-26T15:32:20.120 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-07-26T15:32:20.120 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-RcRvanhE8TM2GI30ssMjqCO4WmKn6yFUQInw1MDsfvND5k80HTY6OeXcv46cdJh5'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.159597", "end": "2021-07-26 15:32:20.093345", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-RcRvanhE8TM2GI30ssMjqCO4WmKn6yFUQInw1MDsfvND5k80HTY6OeXcv46cdJh5"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:32:19.933748", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.154581 s, 746 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.154581 s, 746 MB/s"], "stdout": "", "stdout_lines": []} 2021-07-26T15:32:20.167 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:20 +0000 (0:00:00.065) 0:02:57.722 *********** 2021-07-26T15:32:20.174 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-07-26T15:32:20.246 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:20 +0000 (0:00:00.079) 0:02:57.801 *********** 2021-07-26T15:32:20.275 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-07-26T15:32:20.277 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:20.301 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:20 +0000 (0:00:00.054) 0:02:57.856 *********** 2021-07-26T15:32:20.331 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:20.353 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:20 +0000 (0:00:00.051) 0:02:57.908 *********** 2021-07-26T15:32:20.380 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-07-26T15:32:20.382 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:20.406 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:20 +0000 (0:00:00.053) 0:02:57.961 *********** 2021-07-26T15:32:20.434 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-07-26T15:32:20.436 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:20.457 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:20 +0000 (0:00:00.050) 0:02:58.012 *********** 2021-07-26T15:32:20.495 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-07-26T15:32:20.497 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.149327", "end": "2021-07-26 15:32:20.430247", "rc": 0, "start": "2021-07-26 15:32:20.280920", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:32:20.527 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:20 +0000 (0:00:00.069) 0:02:58.082 *********** 2021-07-26T15:32:20.587 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-07-26T15:32:20.588 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-07-26T15:32:20.614 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:20 +0000 (0:00:00.086) 0:02:58.169 *********** 2021-07-26T15:32:20.653 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-07-26T15:32:20.654 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'block_used': 13859358, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226235750, 'size_available': 926661632000, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 150120, 'block_size': 4096, 'inode_available': 60904856}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226235750, "block_size": 4096, "block_total": 240095108, "block_used": 13859358, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60904856, "inode_total": 61054976, "inode_used": 150120, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926661632000, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:20.677 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:20 +0000 (0:00:00.063) 0:02:58.233 *********** 2021-07-26T15:32:20.705 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-07-26T15:32:20.707 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:20.729 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:20 +0000 (0:00:00.051) 0:02:58.284 *********** 2021-07-26T15:32:20.757 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-07-26T15:32:20.759 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for physical volumes] *********************************** changed: [smithi197.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.091327", "end": "2021-07-26 15:32:20.734983", "rc": 0, "start": "2021-07-26 15:32:20.643656", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:32:20.781 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:20 +0000 (0:00:00.052) 0:02:58.336 *********** 2021-07-26T15:32:20.802 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:20 +0000 (0:00:00.021) 0:02:58.358 *********** 2021-07-26T15:32:20.809 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-07-26T15:32:20.811 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:20.835 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:20 +0000 (0:00:00.032) 0:02:58.390 *********** 2021-07-26T15:32:20.841 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-07-26T15:32:20.867 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:20 +0000 (0:00:00.032) 0:02:58.423 *********** 2021-07-26T15:32:20.874 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-07-26T15:32:20.875 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:20.899 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:20 +0000 (0:00:00.031) 0:02:58.454 *********** 2021-07-26T15:32:20.905 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-07-26T15:32:20.907 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:20.932 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:20 +0000 (0:00:00.033) 0:02:58.488 *********** 2021-07-26T15:32:20.939 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-07-26T15:32:20.940 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:20.964 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:20 +0000 (0:00:00.031) 0:02:58.519 *********** 2021-07-26T15:32:20.970 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-07-26T15:32:20.972 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:20.994 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:20 +0000 (0:00:00.030) 0:02:58.550 *********** 2021-07-26T15:32:21.000 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-07-26T15:32:21.002 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:21.028 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:21 +0000 (0:00:00.033) 0:02:58.583 *********** 2021-07-26T15:32:21.035 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-07-26T15:32:21.037 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:21.063 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:21 +0000 (0:00:00.034) 0:02:58.618 *********** 2021-07-26T15:32:21.090 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-07-26T15:32:21.092 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:21.113 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:21 +0000 (0:00:00.050) 0:02:58.668 *********** 2021-07-26T15:32:21.244 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-07-26T15:32:21.246 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-07-26T15:32:21.274 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:21 +0000 (0:00:00.160) 0:02:58.829 *********** 2021-07-26T15:32:21.312 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-07-26T15:32:21.314 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'block_used': 13859375, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226235733, 'size_available': 926661562368, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 150120, 'block_size': 4096, 'inode_available': 60904856}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226235733, "block_size": 4096, "block_total": 240095108, "block_used": 13859375, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60904856, "inode_total": 61054976, "inode_used": 150120, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926661562368, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:21.342 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:21 +0000 (0:00:00.068) 0:02:58.897 *********** 2021-07-26T15:32:21.369 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-07-26T15:32:21.371 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:21.398 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:21 +0000 (0:00:00.055) 0:02:58.953 *********** 2021-07-26T15:32:21.425 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-07-26T15:32:21.426 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:21.449 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:21 +0000 (0:00:00.051) 0:02:59.005 *********** 2021-07-26T15:32:21.476 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-07-26T15:32:21.478 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:21.499 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:21 +0000 (0:00:00.049) 0:02:59.054 *********** 2021-07-26T15:32:21.526 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-07-26T15:32:21.528 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:21.551 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:21 +0000 (0:00:00.051) 0:02:59.106 *********** 2021-07-26T15:32:21.578 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-07-26T15:32:21.580 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:21.602 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:21 +0000 (0:00:00.050) 0:02:59.157 *********** 2021-07-26T15:32:21.639 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:21.662 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:21 +0000 (0:00:00.060) 0:02:59.217 *********** 2021-07-26T15:32:21.888 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-07-26T15:32:21.890 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-07-26T15:32:21.919 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:21 +0000 (0:00:00.257) 0:02:59.474 *********** 2021-07-26T15:32:22.186 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-07-26T15:32:22.210 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:22 +0000 (0:00:00.290) 0:02:59.765 *********** 2021-07-26T15:32:22.705 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-07-26T15:32:22.707 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-07-26T15:32:22.716 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-07-26T15:32:23.119 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-07-26T15:32:23.120 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-07-26T15:32:23.489 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-07-26T15:32:23.532 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-07-26T15:32:23.876 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-07-26T15:32:23.908 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-07-26T15:32:24.231 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-07-26T15:32:24.256 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:24 +0000 (0:00:02.045) 0:03:01.811 *********** 2021-07-26T15:32:24.296 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-07-26T15:32:24.320 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:24 +0000 (0:00:00.064) 0:03:01.875 *********** 2021-07-26T15:32:24.410 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-07-26T15:32:24.412 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-07-26T15:32:24.436 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:24 +0000 (0:00:00.115) 0:03:01.991 *********** 2021-07-26T15:32:24.464 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-07-26T15:32:24.489 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:24 +0000 (0:00:00.053) 0:03:02.044 *********** 2021-07-26T15:32:24.590 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-07-26T15:32:24.592 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-07-26T15:32:24.655 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-07-26T15:32:24.710 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-07-26T15:32:24.785 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-07-26T15:32:24.828 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-07-26T15:32:24.894 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-07-26T15:32:24.948 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-07-26T15:32:24.958 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:24.985 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:24 +0000 (0:00:00.495) 0:03:02.540 *********** 2021-07-26T15:32:25.014 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} TASK [testnode : Create filesystems] ******************************************* skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:25.036 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:25 +0000 (0:00:00.051) 0:03:02.591 *********** 2021-07-26T15:32:25.043 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-07-26T15:32:25.044 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:25.070 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:25 +0000 (0:00:00.033) 0:03:02.625 *********** 2021-07-26T15:32:25.077 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-07-26T15:32:25.078 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:25.101 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:25 +0000 (0:00:00.031) 0:03:02.656 *********** 2021-07-26T15:32:25.106 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-07-26T15:32:25.108 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:25.131 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:25 +0000 (0:00:00.030) 0:03:02.686 *********** 2021-07-26T15:32:25.157 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-07-26T15:32:25.159 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:25.180 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:25 +0000 (0:00:00.048) 0:03:02.735 *********** 2021-07-26T15:32:25.238 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-07-26T15:32:25.240 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-07-26T15:32:25.277 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:25 +0000 (0:00:00.096) 0:03:02.831 *********** 2021-07-26T15:32:25.318 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-07-26T15:32:25.320 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} TASK [testnode : Create /var/lib/ceph] ***************************************** ok: [smithi183.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-07-26T15:32:25.354 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:25 +0000 (0:00:00.077) 0:03:02.909 *********** 2021-07-26T15:32:25.388 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:25 +0000 (0:00:00.034) 0:03:02.943 *********** 2021-07-26T15:32:25.394 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-07-26T15:32:25.396 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-07-26T15:32:25.423 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:25 +0000 (0:00:00.034) 0:03:02.978 *********** 2021-07-26T15:32:25.936 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2021-07-26T15:32:25.938 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => {"changed": true} 2021-07-26T15:32:25.961 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:25 +0000 (0:00:00.538) 0:03:03.516 *********** 2021-07-26T15:32:25.968 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"changed": true} 2021-07-26T15:32:25.993 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:25 +0000 (0:00:00.032) 0:03:03.548 *********** 2021-07-26T15:32:26.458 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-07-26T15:32:26.460 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-07-26T15:32:26.483 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:26 +0000 (0:00:00.489) 0:03:04.038 *********** 2021-07-26T15:32:26.490 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-07-26T15:32:26.515 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:26 +0000 (0:00:00.032) 0:03:04.070 *********** 2021-07-26T15:32:26.522 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-07-26T15:32:26.524 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:26.551 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:26 +0000 (0:00:00.035) 0:03:04.106 *********** 2021-07-26T15:32:26.559 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:26.586 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:26 +0000 (0:00:00.034) 0:03:04.140 *********** 2021-07-26T15:32:26.594 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-07-26T15:32:26.596 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:26.620 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:26 +0000 (0:00:00.034) 0:03:04.175 *********** 2021-07-26T15:32:26.627 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:26.652 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:26 +0000 (0:00:00.032) 0:03:04.207 *********** 2021-07-26T15:32:26.659 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-07-26T15:32:26.660 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:26.684 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:26 +0000 (0:00:00.031) 0:03:04.239 *********** 2021-07-26T15:32:26.691 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:26.720 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:26 +0000 (0:00:00.036) 0:03:04.275 *********** 2021-07-26T15:32:26.730 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-07-26T15:32:26.732 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:26.757 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:26 +0000 (0:00:00.036) 0:03:04.312 *********** 2021-07-26T15:32:26.765 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:26.791 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:26 +0000 (0:00:00.034) 0:03:04.346 *********** 2021-07-26T15:32:26.921 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-07-26T15:32:26.923 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-07-26T15:32:26.949 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:26 +0000 (0:00:00.157) 0:03:04.504 *********** 2021-07-26T15:32:26.957 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-07-26T15:32:26.984 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:26 +0000 (0:00:00.034) 0:03:04.539 *********** 2021-07-26T15:32:27.105 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-07-26T15:32:27.107 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-07-26T15:32:27.130 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:27 +0000 (0:00:00.146) 0:03:04.685 *********** 2021-07-26T15:32:27.138 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-07-26T15:32:27.164 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:27 +0000 (0:00:00.033) 0:03:04.719 *********** 2021-07-26T15:32:27.492 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** ok: [smithi183.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-07-26T15:32:27.517 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:27 +0000 (0:00:00.352) 0:03:05.072 *********** 2021-07-26T15:32:27.523 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-07-26T15:32:27.549 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:27 +0000 (0:00:00.031) 0:03:05.104 *********** 2021-07-26T15:32:27.858 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-07-26T15:32:27.861 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-07-26T15:32:27.883 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:27 +0000 (0:00:00.334) 0:03:05.438 *********** 2021-07-26T15:32:27.890 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-07-26T15:32:27.920 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:27 +0000 (0:00:00.037) 0:03:05.476 *********** 2021-07-26T15:32:28.550 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-07-26T15:32:28.552 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => {"cache_update_time": 1627313442, "cache_updated": false, "changed": false} 2021-07-26T15:32:28.575 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:28 +0000 (0:00:00.654) 0:03:06.130 *********** 2021-07-26T15:32:28.595 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"cache_update_time": 1627313442, "cache_updated": false, "changed": false} 2021-07-26T15:32:28.618 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:28 +0000 (0:00:00.042) 0:03:06.172 *********** 2021-07-26T15:32:28.845 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-07-26T15:32:28.847 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.120163", "end": "2021-07-26 15:32:29.293545", "rc": 0, "start": "2021-07-26 15:32:29.173382", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2021-07-26T15:32:28.871 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:28 +0000 (0:00:00.253) 0:03:06.426 *********** 2021-07-26T15:32:28.889 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.118985", "end": "2021-07-26 15:32:28.857680", "rc": 0, "start": "2021-07-26 15:32:28.738695", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2021-07-26T15:32:28.913 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:28 +0000 (0:00:00.042) 0:03:06.469 *********** 2021-07-26T15:32:28.921 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-07-26T15:32:28.922 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:28.947 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:28 +0000 (0:00:00.033) 0:03:06.502 *********** 2021-07-26T15:32:28.954 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:28.978 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:28 +0000 (0:00:00.031) 0:03:06.533 *********** 2021-07-26T15:32:28.986 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:29.009 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:29 +0000 (0:00:00.030) 0:03:06.564 *********** 2021-07-26T15:32:29.015 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:29.040 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:29 +0000 (0:00:00.031) 0:03:06.595 *********** 2021-07-26T15:32:29.669 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-07-26T15:32:29.671 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => {"cache_update_time": 1627313442, "cache_updated": false, "changed": false} 2021-07-26T15:32:29.701 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:29 +0000 (0:00:00.660) 0:03:07.256 *********** 2021-07-26T15:32:29.710 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"cache_update_time": 1627313442, "cache_updated": false, "changed": false} 2021-07-26T15:32:29.735 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:29 +0000 (0:00:00.034) 0:03:07.290 *********** 2021-07-26T15:32:29.743 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:29.768 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:29 +0000 (0:00:00.032) 0:03:07.323 *********** 2021-07-26T15:32:29.776 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:29.803 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:29 +0000 (0:00:00.034) 0:03:07.358 *********** 2021-07-26T15:32:30.102 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-07-26T15:32:30.104 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-07-26T15:32:30.127 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:30 +0000 (0:00:00.324) 0:03:07.682 *********** 2021-07-26T15:32:30.145 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-07-26T15:32:30.168 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:30 +0000 (0:00:00.040) 0:03:07.723 *********** 2021-07-26T15:32:30.174 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-07-26T15:32:30.176 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:30.199 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:30 +0000 (0:00:00.031) 0:03:07.754 *********** 2021-07-26T15:32:30.207 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:30.232 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:30 +0000 (0:00:00.032) 0:03:07.787 *********** 2021-07-26T15:32:30.405 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-07-26T15:32:30.406 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2021-07-26 15:29:13 UTC", "ActiveEnterTimestampMonotonic": "13411479", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "system.slice basic.target network.target systemd-tmpfiles-setup.service sysinit.target systemd-journald.socket -.mount", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-07-26 15:29:13 UTC", "AssertTimestampMonotonic": "13279180", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-07-26 15:29:13 UTC", "ConditionTimestampMonotonic": "13279179", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service", "ControlGroup": 2021-07-26T15:32:30.408 INFO:teuthology.task.ansible.out: "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "831", "ExecMainStartTimestamp": "Mon 2021-07-26 15:29:13 UTC", "ExecMainStartTimestampMonotonic": "13411466", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2021-07-26 15:29:13 UTC", "InactiveExitTimestampMonotonic": "13280225", "InvocationID": "2d56412f50b741d8ae033a62ff5e9182", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Lim 2021-07-26T15:32:30.409 INFO:teuthology.task.ansible.out:itCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127777", "LimitNPROCSoft": "127777", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127777", "LimitSIGPENDINGSoft": "127777", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "831", "MemoryAccounting": "yes", "MemoryCurrent": "3686400", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "Requi 2021-07-26T15:32:30.411 INFO:teuthology.task.ansible.out:resMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-07-26 15:29:13 UTC", "StateChangeTimestampMonotonic": "13411479", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38333", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-07-26T15:32:30.432 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:30 +0000 (0:00:00.200) 0:03:07.987 *********** 2021-07-26T15:32:30.451 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2021-07-26 15:27:55 UTC", "ActiveEnterTimestampMonotonic": "13655827", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-journald.socket systemd-tmpfiles-setup.service -.mount basic.target system.slice sysinit.target network.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-07-26 15:27:55 UTC", "AssertTimestampMonotonic": "13511252", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-07-26 15:27:55 UTC", "ConditionTimestampMonotonic": "13511251", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target", "ControlGroup": 2021-07-26T15:32:30.453 INFO:teuthology.task.ansible.out: "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "823", "ExecMainStartTimestamp": "Mon 2021-07-26 15:27:55 UTC", "ExecMainStartTimestampMonotonic": "13655815", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2021-07-26 15:27:55 UTC", "InactiveExitTimestampMonotonic": "13512219", "InvocationID": "c28c14c48aa842b585f195caf72af56a", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Lim 2021-07-26T15:32:30.456 INFO:teuthology.task.ansible.out:itCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127777", "LimitNPROCSoft": "127777", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127777", "LimitSIGPENDINGSoft": "127777", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "823", "MemoryAccounting": "yes", "MemoryCurrent": "3375104", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "Requi 2021-07-26T15:32:30.458 INFO:teuthology.task.ansible.out:resMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-07-26 15:27:55 UTC", "StateChangeTimestampMonotonic": "13655827", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38333", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-07-26T15:32:30.475 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:30 +0000 (0:00:00.042) 0:03:08.030 *********** 2021-07-26T15:32:30.482 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-07-26T15:32:30.484 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-07-26T15:32:30.507 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:30 +0000 (0:00:00.031) 0:03:08.062 *********** 2021-07-26T15:32:30.514 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-07-26T15:32:30.539 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:30 +0000 (0:00:00.032) 0:03:08.094 *********** 2021-07-26T15:32:30.545 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-07-26T15:32:30.547 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-07-26T15:32:30.571 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:30 +0000 (0:00:00.031) 0:03:08.126 *********** 2021-07-26T15:32:30.577 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-07-26T15:32:30.601 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:30 +0000 (0:00:00.030) 0:03:08.156 *********** 2021-07-26T15:32:30.608 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-07-26T15:32:30.609 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:30.632 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:30 +0000 (0:00:00.030) 0:03:08.187 *********** 2021-07-26T15:32:30.638 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:30.664 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:30 +0000 (0:00:00.031) 0:03:08.219 *********** 2021-07-26T15:32:31.771 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-07-26T15:32:31.773 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => {"cache_update_time": 1627313442, "cache_updated": false, "changed": false} 2021-07-26T15:32:31.796 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:31 +0000 (0:00:01.131) 0:03:09.351 *********** 2021-07-26T15:32:31.805 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"cache_update_time": 1627313442, "cache_updated": false, "changed": false} 2021-07-26T15:32:31.833 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:31 +0000 (0:00:00.037) 0:03:09.389 *********** 2021-07-26T15:32:31.840 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-07-26T15:32:31.842 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:31.867 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:31 +0000 (0:00:00.033) 0:03:09.422 *********** 2021-07-26T15:32:31.874 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:31.902 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:31 +0000 (0:00:00.035) 0:03:09.458 *********** 2021-07-26T15:32:32.054 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-07-26T15:32:32.056 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-07-26T15:32:32.078 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:32 +0000 (0:00:00.175) 0:03:09.633 *********** 2021-07-26T15:32:32.085 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-07-26T15:32:32.110 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:32 +0000 (0:00:00.032) 0:03:09.665 *********** 2021-07-26T15:32:32.532 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** ok: [smithi183.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-07-26T15:32:32.555 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:32 +0000 (0:00:00.445) 0:03:10.111 *********** 2021-07-26T15:32:32.563 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-07-26T15:32:32.588 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:32 +0000 (0:00:00.032) 0:03:10.143 *********** 2021-07-26T15:32:34.871 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-07-26T15:32:34.872 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2021-07-26T15:32:34.896 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:34 +0000 (0:00:02.307) 0:03:12.451 *********** 2021-07-26T15:32:34.946 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2021-07-26T15:32:34.972 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:34 +0000 (0:00:00.075) 0:03:12.527 *********** 2021-07-26T15:32:35.386 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-07-26T15:32:35.388 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => {"changed": false} 2021-07-26T15:32:35.412 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:35 +0000 (0:00:00.439) 0:03:12.966 *********** 2021-07-26T15:32:35.439 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-07-26T15:32:35.441 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2021-07-26T15:32:35.462 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:35 +0000 (0:00:00.050) 0:03:13.017 *********** 2021-07-26T15:32:35.468 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-07-26T15:32:35.471 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false} 2021-07-26T15:32:35.494 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:35 +0000 (0:00:00.032) 0:03:13.049 *********** 2021-07-26T15:32:35.521 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ ok: [smithi197.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2021-07-26T15:32:35.544 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:35 +0000 (0:00:00.050) 0:03:13.100 *********** 2021-07-26T15:32:35.645 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-07-26T15:32:35.647 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1627313032.261613, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1627313032.257613, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 105181, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1627313032.257613, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "1956422440", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-07-26T15:32:35.671 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:35 +0000 (0:00:00.126) 0:03:13.226 *********** 2021-07-26T15:32:35.741 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1627313031.3637447, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1627313031.3597448, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 105181, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1627313031.3597448, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "1956422440", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-07-26T15:32:35.766 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:35 +0000 (0:00:00.094) 0:03:13.321 *********** 2021-07-26T15:32:36.115 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-07-26T15:32:36.117 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-07-26T15:32:36.142 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:36 +0000 (0:00:00.375) 0:03:13.697 *********** 2021-07-26T15:32:36.150 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-07-26T15:32:36.175 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:36 +0000 (0:00:00.033) 0:03:13.731 *********** 2021-07-26T15:32:36.182 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-07-26T15:32:36.184 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-07-26T15:32:36.207 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:36 +0000 (0:00:00.031) 0:03:13.763 *********** 2021-07-26T15:32:36.214 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-07-26T15:32:36.239 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:36 +0000 (0:00:00.031) 0:03:13.794 *********** 2021-07-26T15:32:36.244 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-07-26T15:32:36.246 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:36.270 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:36 +0000 (0:00:00.030) 0:03:13.825 *********** 2021-07-26T15:32:36.277 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:36.302 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:36 +0000 (0:00:00.032) 0:03:13.858 *********** 2021-07-26T15:32:36.444 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-07-26T15:32:36.446 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-07-26T15:32:36.469 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:36 +0000 (0:00:00.166) 0:03:14.025 *********** 2021-07-26T15:32:36.477 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-07-26T15:32:36.502 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:36 +0000 (0:00:00.032) 0:03:14.057 *********** 2021-07-26T15:32:36.643 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-07-26T15:32:36.646 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-07-26T15:32:36.668 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:36 +0000 (0:00:00.165) 0:03:14.223 *********** 2021-07-26T15:32:36.675 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-07-26T15:32:36.699 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:36 +0000 (0:00:00.030) 0:03:14.254 *********** 2021-07-26T15:32:36.705 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-07-26T15:32:36.707 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:36.730 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:36 +0000 (0:00:00.030) 0:03:14.285 *********** 2021-07-26T15:32:36.736 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:36.761 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:36 +0000 (0:00:00.031) 0:03:14.316 *********** 2021-07-26T15:32:36.768 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-07-26T15:32:36.770 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [smithi183.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-07-26T15:32:36.781 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-07-26T15:32:36.783 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2021-07-26T15:32:36.809 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:36 +0000 (0:00:00.048) 0:03:14.365 *********** 2021-07-26T15:32:36.817 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2021-07-26T15:32:36.818 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2021-07-26T15:32:36.829 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-07-26T15:32:36.988 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:36 +0000 (0:00:00.177) 0:03:14.542 *********** 2021-07-26T15:32:36.994 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-07-26T15:32:36.995 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:37.005 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:37.007 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:37.017 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:37.019 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:37.043 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:37 +0000 (0:00:00.056) 0:03:14.598 *********** 2021-07-26T15:32:37.050 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:37.052 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi197.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:37.054 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:37.080 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:37 +0000 (0:00:00.035) 0:03:14.634 *********** 2021-07-26T15:32:37.086 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-07-26T15:32:37.088 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:37.113 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:37 +0000 (0:00:00.034) 0:03:14.668 *********** 2021-07-26T15:32:37.120 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:37.146 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:37 +0000 (0:00:00.033) 0:03:14.702 *********** 2021-07-26T15:32:37.153 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-07-26T15:32:37.155 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:37.178 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:37 +0000 (0:00:00.031) 0:03:14.733 *********** 2021-07-26T15:32:37.185 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:37.209 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:37 +0000 (0:00:00.031) 0:03:14.765 *********** 2021-07-26T15:32:37.216 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-07-26T15:32:37.217 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:37.243 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:37 +0000 (0:00:00.033) 0:03:14.798 *********** 2021-07-26T15:32:37.249 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:37.275 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:37 +0000 (0:00:00.032) 0:03:14.830 *********** 2021-07-26T15:32:37.282 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-07-26T15:32:37.283 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:37.306 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:37 +0000 (0:00:00.031) 0:03:14.861 *********** 2021-07-26T15:32:37.313 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:37.341 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:37 +0000 (0:00:00.034) 0:03:14.896 *********** 2021-07-26T15:32:37.347 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-07-26T15:32:37.349 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:37.374 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:37 +0000 (0:00:00.033) 0:03:14.929 *********** 2021-07-26T15:32:37.381 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:37.411 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:37 +0000 (0:00:00.036) 0:03:14.966 *********** 2021-07-26T15:32:37.418 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-07-26T15:32:37.419 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:37.444 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:37 +0000 (0:00:00.033) 0:03:14.999 *********** 2021-07-26T15:32:37.451 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:37.477 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:37 +0000 (0:00:00.032) 0:03:15.032 *********** 2021-07-26T15:32:37.483 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-07-26T15:32:37.485 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:37.509 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:37 +0000 (0:00:00.032) 0:03:15.065 *********** 2021-07-26T15:32:37.516 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:37.543 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:37 +0000 (0:00:00.033) 0:03:15.098 *********** 2021-07-26T15:32:37.550 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-07-26T15:32:37.553 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:37.575 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:37 +0000 (0:00:00.032) 0:03:15.130 *********** 2021-07-26T15:32:37.581 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:37.606 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:37 +0000 (0:00:00.031) 0:03:15.161 *********** 2021-07-26T15:32:37.767 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-07-26T15:32:37.769 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.010249", "end": "2021-07-26 15:32:37.737595", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-07-26 15:32:37.727346", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:32:37.810 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.010593", "end": "2021-07-26 15:32:37.784046", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-07-26 15:32:37.773453", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:32:37.936 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.006089", "end": "2021-07-26 15:32:37.900210", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-07-26 15:32:37.894121", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:32:37.978 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.005837", "end": "2021-07-26 15:32:37.947280", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-07-26 15:32:37.941443", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:32:38.093 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005577", "end": "2021-07-26 15:32:38.057035", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-07-26 15:32:38.051458", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-07-26T15:32:38.125 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005522", "end": "2021-07-26 15:32:38.102839", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-07-26 15:32:38.097317", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-07-26T15:32:38.271 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.026842", "end": "2021-07-26 15:32:38.234128", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-07-26 15:32:38.207286", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:32:38.296 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:38 +0000 (0:00:00.690) 0:03:15.852 *********** 2021-07-26T15:32:38.316 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.027787", "end": "2021-07-26 15:32:38.279172", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-07-26 15:32:38.251385", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:32:38.340 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:38 +0000 (0:00:00.043) 0:03:15.896 *********** 2021-07-26T15:32:38.347 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-07-26T15:32:38.372 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:38 +0000 (0:00:00.031) 0:03:15.927 *********** 2021-07-26T15:32:38.409 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:38 +0000 (0:00:00.036) 0:03:15.964 *********** 2021-07-26T15:32:38.416 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-07-26T15:32:38.418 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:38.440 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:38.517 INFO:teuthology.task.ansible.out: PLAY [testnodes,senta,vossi,jenkins_slaves] ************************************ 2021-07-26T15:32:38.536 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:38 +0000 (0:00:00.127) 0:03:16.092 *********** 2021-07-26T15:32:38.558 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:38 +0000 (0:00:00.021) 0:03:16.113 *********** 2021-07-26T15:32:39.540 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi183.front.sepia.ceph.com] 2021-07-26T15:32:39.572 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] 2021-07-26T15:32:39.599 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:39 +0000 (0:00:01.041) 0:03:17.154 *********** 2021-07-26T15:32:39.642 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:39 +0000 (0:00:00.042) 0:03:17.197 *********** 2021-07-26T15:32:39.648 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-07-26T15:32:39.650 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-07-26T15:32:39.674 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:39 +0000 (0:00:00.032) 0:03:17.229 *********** 2021-07-26T15:32:39.681 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-07-26T15:32:39.706 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:39 +0000 (0:00:00.031) 0:03:17.261 *********** 2021-07-26T15:32:39.713 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-07-26T15:32:39.714 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:39.739 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:39 +0000 (0:00:00.033) 0:03:17.295 *********** 2021-07-26T15:32:39.747 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:39.772 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:39 +0000 (0:00:00.033) 0:03:17.328 *********** 2021-07-26T15:32:39.780 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-07-26T15:32:39.782 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-07-26T15:32:39.807 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:39 +0000 (0:00:00.034) 0:03:17.362 *********** 2021-07-26T15:32:39.815 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-07-26T15:32:39.851 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:39 +0000 (0:00:00.044) 0:03:17.406 *********** 2021-07-26T15:32:55.830 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-07-26T15:32:55.832 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => {"cache_update_time": 1627313442, "cache_updated": false, "changed": true, "stderr": "", "stderr_lines": [], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nSuggested packages:\n aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils\nThe following packages will be upgraded:\n docker.io\n1 upgraded, 0 newly installed, 0 to remove and 143 not upgraded.\nNeed to get 36.9 MB of archives.\nAfter this operation, 931 kB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.2-0ubuntu1~20.04.3 [36.9 MB]\nPreconfiguring packages ...\nFetched 36.9 MB in 2s (18.7 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138111 files and directories currently installed.)\r\nPreparing to unpack .../docker.io_20.10.2-0ubuntu1~20.04.3_amd64.deb ...\r\nUnpacking docker.io (20.10.2-0ubuntu1~20.04.3) over (19.03.8-0ubuntu1.20.04.2) ...\r\nSetting up docker.io (20.10.2-0ubuntu1~20.04.3) ...\r\nCreated symlink /etc/systemd/system/multi-user.target.wants/docker.service -> /lib/systemd/system/docker.service.\r\nProcessing triggers for man-db (2.9.1-1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "Suggested packages:", " aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils", "The followin 2021-07-26T15:32:55.834 INFO:teuthology.task.ansible.out:g packages will be upgraded:", " docker.io", "1 upgraded, 0 newly installed, 0 to remove and 143 not upgraded.", "Need to get 36.9 MB of archives.", "After this operation, 931 kB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.2-0ubuntu1~20.04.3 [36.9 MB]", "Preconfiguring packages ...", "Fetched 36.9 MB in 2s (18.7 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138111 files and directories currently installed.)", "Preparing to unpack .../docker.io_20.10.2-0ubuntu1~20.04.3_amd64.deb ...", "Unpacking docker.io (20.10.2-0ubuntu1~20.04.3) over (19.03.8-0ubuntu1.20.04.2) ...", "Setting up docker.io (20.10.2-0ubuntu1~20.04.3) ...", "Created symlink /etc/systemd/system/multi-user.target.wants/docker.service -> /lib/systemd/system/docker.service.", "Processing triggers for man-db (2.9.1-1) ..."]} 2021-07-26T15:32:55.855 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:55 +0000 (0:00:16.003) 0:03:33.410 *********** 2021-07-26T15:32:55.883 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-07-26T15:32:55.885 INFO:teuthology.task.ansible.out:skipping: [smithi183.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:32:55.907 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:55 +0000 (0:00:00.051) 0:03:33.462 *********** 2021-07-26T15:32:55.944 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-07-26T15:32:55.946 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-07-26T15:32:55.969 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:55 +0000 (0:00:00.062) 0:03:33.524 *********** 2021-07-26T15:32:56.122 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-07-26T15:32:56.124 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"cache_update_time": 1627313442, "cache_updated": false, "changed": true, "stderr": "", "stderr_lines": [], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nSuggested packages:\n aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils\nThe following packages will be upgraded:\n docker.io\n1 upgraded, 0 newly installed, 0 to remove and 143 not upgraded.\nNeed to get 36.9 MB of archives.\nAfter this operation, 931 kB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.2-0ubuntu1~20.04.3 [36.9 MB]\nPreconfiguring packages ...\nFetched 36.9 MB in 2s (18.6 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138111 files and directories currently installed.)\r\nPreparing to unpack .../docker.io_20.10.2-0ubuntu1~20.04.3_amd64.deb ...\r\nUnpacking docker.io (20.10.2-0ubuntu1~20.04.3) over (19.03.8-0ubuntu1.20.04.2) ...\r\nSetting up docker.io (20.10.2-0ubuntu1~20.04.3) ...\r\nCreated symlink /etc/systemd/system/multi-user.target.wants/docker.service -> /lib/systemd/system/docker.service.\r\nProcessing triggers for man-db (2.9.1-1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "Suggested packages:", " aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils", "The followin 2021-07-26T15:32:56.125 INFO:teuthology.task.ansible.out:g packages will be upgraded:", " docker.io", "1 upgraded, 0 newly installed, 0 to remove and 143 not upgraded.", "Need to get 36.9 MB of archives.", "After this operation, 931 kB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.2-0ubuntu1~20.04.3 [36.9 MB]", "Preconfiguring packages ...", "Fetched 36.9 MB in 2s (18.6 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138111 files and directories currently installed.)", "Preparing to unpack .../docker.io_20.10.2-0ubuntu1~20.04.3_amd64.deb ...", "Unpacking docker.io (20.10.2-0ubuntu1~20.04.3) over (19.03.8-0ubuntu1.20.04.2) ...", "Setting up docker.io (20.10.2-0ubuntu1~20.04.3) ...", "Created symlink /etc/systemd/system/multi-user.target.wants/docker.service -> /lib/systemd/system/docker.service.", "Processing triggers for man-db (2.9.1-1) ..."]} 2021-07-26T15:32:56.148 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:56 +0000 (0:00:00.179) 0:03:33.703 *********** 2021-07-26T15:32:56.176 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-07-26T15:32:56.177 INFO:teuthology.task.ansible.out:skipping: [smithi197.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [container-host : Create container_mirror_cert_paths] ********************* changed: [smithi183.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-07-26T15:32:56.202 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:56 +0000 (0:00:00.053) 0:03:33.757 *********** 2021-07-26T15:32:56.242 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-07-26T15:32:56.244 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-07-26T15:32:56.265 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:56 +0000 (0:00:00.063) 0:03:33.821 *********** 2021-07-26T15:32:56.335 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-07-26T15:32:56.337 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-07-26T15:32:56.365 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:56 +0000 (0:00:00.099) 0:03:33.920 *********** 2021-07-26T15:32:56.467 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-07-26T15:32:56.630 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-07-26T15:32:56.656 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:56 +0000 (0:00:00.291) 0:03:34.211 *********** 2021-07-26T15:32:56.842 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-07-26T15:32:56.844 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1627313576.424128-26173-5129208616108/source", "state": "file", "uid": 0} 2021-07-26T15:32:57.125 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1627313576.7130835-26234-106565610618639/source", "state": "file", "uid": 0} 2021-07-26T15:32:57.251 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1627313576.8641224-26173-91029651313694/source", "state": "file", "uid": 0} 2021-07-26T15:32:57.277 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:57 +0000 (0:00:00.620) 0:03:34.832 *********** 2021-07-26T15:32:57.562 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1627313577.1459906-26234-25852231680052/source", "state": "file", "uid": 0} 2021-07-26T15:32:57.593 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:57 +0000 (0:00:00.316) 0:03:35.148 *********** 2021-07-26T15:32:58.048 INFO:teuthology.task.ansible.out: TASK [container-host : Ensure git is installed] ******************************** 2021-07-26T15:32:58.050 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] => {"cache_update_time": 1627313442, "cache_updated": false, "changed": false} 2021-07-26T15:32:58.072 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:58 +0000 (0:00:00.479) 0:03:35.628 *********** 2021-07-26T15:32:58.365 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] => {"cache_update_time": 1627313442, "cache_updated": false, "changed": false} 2021-07-26T15:32:58.392 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:32:58 +0000 (0:00:00.319) 0:03:35.947 *********** 2021-07-26T15:33:02.597 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-07-26T15:33:02.599 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => {"changed": true, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-6vp1l1c1\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-6vp1l1c1"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-6vp1l1c1\nCollecting docopt\n Downloading docopt-0.6.2.tar.gz (25 kB)\nCollecting toml\n Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)\nBuilding wheels for collected packages: registries-conf-ctl, docopt\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=6035 sha256=fa4fb2ba7f52ba4780d2bd6bcdb240b4b8777b3d75af32ec93c91d260ffca717\n Stored in directory: /tmp/pip-ephem-wheel-cache-z_3l2ven/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\n Building wheel for docopt (setup.py): started\n Building wheel for docopt (setup.py): finished with status 'done'\n Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=8f7b438c547a9f3f064b9ecb592f27bc5d2a4e46d9c1b31ac0c8ef1c8f7d15c2\n Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c\nSuccessfully built registries-conf-ctl docopt\nInstalling collected packages: docopt, toml, registries-conf-ctl\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2\n", "stdout_lines": ["Collecting git+https://github. 2021-07-26T15:33:02.601 INFO:teuthology.task.ansible.out:com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-6vp1l1c1", "Collecting docopt", " Downloading docopt-0.6.2.tar.gz (25 kB)", "Collecting toml", " Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)", "Building wheels for collected packages: registries-conf-ctl, docopt", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=6035 sha256=fa4fb2ba7f52ba4780d2bd6bcdb240b4b8777b3d75af32ec93c91d260ffca717", " Stored in directory: /tmp/pip-ephem-wheel-cache-z_3l2ven/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", " Building wheel for docopt (setup.py): started", " Building wheel for docopt (setup.py): finished with status 'done'", " Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=8f7b438c547a9f3f064b9ecb592f27bc5d2a4e46d9c1b31ac0c8ef1c8f7d15c2", " Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c", "Successfully built registries-conf-ctl docopt", "Installing collected packages: docopt, toml, registries-conf-ctl", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2"], "version": null, "virtualenv": null} 2021-07-26T15:33:02.623 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:02 +0000 (0:00:04.230) 0:03:40.178 *********** 2021-07-26T15:33:02.809 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* ok: [smithi183.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-07-26T15:33:02.833 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:02 +0000 (0:00:00.210) 0:03:40.388 *********** 2021-07-26T15:33:03.032 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-07-26T15:33:03.034 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"changed": true, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-bdh6d3zp\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-bdh6d3zp"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-bdh6d3zp\nCollecting docopt\n Downloading docopt-0.6.2.tar.gz (25 kB)\nCollecting toml\n Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)\nBuilding wheels for collected packages: registries-conf-ctl, docopt\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=6035 sha256=fa4fb2ba7f52ba4780d2bd6bcdb240b4b8777b3d75af32ec93c91d260ffca717\n Stored in directory: /tmp/pip-ephem-wheel-cache-pj174avh/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\n Building wheel for docopt (setup.py): started\n Building wheel for docopt (setup.py): finished with status 'done'\n Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=2a6bee04d8944843de0ffffdbe1a19e5aec68ac235ba2ded428b16181230fffe\n Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c\nSuccessfully built registries-conf-ctl docopt\nInstalling collected packages: docopt, toml, registries-conf-ctl\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2\n", "stdout_lines": ["Collecting git+https://github. 2021-07-26T15:33:03.036 INFO:teuthology.task.ansible.out:com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-bdh6d3zp", "Collecting docopt", " Downloading docopt-0.6.2.tar.gz (25 kB)", "Collecting toml", " Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)", "Building wheels for collected packages: registries-conf-ctl, docopt", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=6035 sha256=fa4fb2ba7f52ba4780d2bd6bcdb240b4b8777b3d75af32ec93c91d260ffca717", " Stored in directory: /tmp/pip-ephem-wheel-cache-pj174avh/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", " Building wheel for docopt (setup.py): started", " Building wheel for docopt (setup.py): finished with status 'done'", " Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=2a6bee04d8944843de0ffffdbe1a19e5aec68ac235ba2ded428b16181230fffe", " Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c", "Successfully built registries-conf-ctl docopt", "Installing collected packages: docopt, toml, registries-conf-ctl", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2"], "version": null, "virtualenv": null} 2021-07-26T15:33:03.065 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:03 +0000 (0:00:00.226) 0:03:40.615 *********** 2021-07-26T15:33:03.268 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* ok: [smithi197.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-07-26T15:33:03.292 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:03 +0000 (0:00:00.232) 0:03:40.847 *********** 2021-07-26T15:33:03.299 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ 2021-07-26T15:33:03.301 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => {"changed": true, "checksum": "bf21a9e8fbc5a3846fb05b4fa0859e0917b2202f", "dest": "/etc/docker/daemon.json", "gid": 0, "group": "root", "md5sum": "99914b932bd37a50b983c5e7c90ae93b", "mode": "0644", "owner": "root", "size": 2, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1627313582.8962953-26785-121838302539394/source", "state": "file", "uid": 0} 2021-07-26T15:33:03.327 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:03 +0000 (0:00:00.034) 0:03:40.881 *********** 2021-07-26T15:33:03.550 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-07-26T15:33:03.551 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.039406", "end": "2021-07-26 15:33:03.524396", "rc": 0, "start": "2021-07-26 15:33:03.484990", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:33:03.590 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:03 +0000 (0:00:00.263) 0:03:41.145 *********** 2021-07-26T15:33:03.754 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ 2021-07-26T15:33:03.755 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"changed": true, "checksum": "bf21a9e8fbc5a3846fb05b4fa0859e0917b2202f", "dest": "/etc/docker/daemon.json", "gid": 0, "group": "root", "md5sum": "99914b932bd37a50b983c5e7c90ae93b", "mode": "0644", "owner": "root", "size": 2, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1627313583.3479633-26859-66639009616751/source", "state": "file", "uid": 0} 2021-07-26T15:33:03.779 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:03 +0000 (0:00:00.189) 0:03:41.335 *********** 2021-07-26T15:33:03.999 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-07-26T15:33:04.001 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.036723", "end": "2021-07-26 15:33:03.975361", "rc": 0, "start": "2021-07-26 15:33:03.938638", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:33:04.023 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:04 +0000 (0:00:00.243) 0:03:41.578 *********** 2021-07-26T15:33:05.176 INFO:teuthology.task.ansible.out: TASK [container-host : Restart docker service] ********************************* 2021-07-26T15:33:05.177 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2021-07-26 15:32:51 UTC", "ActiveEnterTimestampMonotonic": "231632485", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-journald.socket containerd.service firewalld.service system.slice sysinit.target basic.target network-online.target docker.socket", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-07-26 15:32:49 UTC", "AssertTimestampMonotonic": "229618933", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-07-26 15:32:49 UTC", "ConditionTimestampMonotonic": "229618932", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.sli 2021-07-26T15:33:05.179 INFO:teuthology.task.ansible.out:ce/docker.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-firewall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8804", "ExecMainStartTimestamp": "Mon 2021-07-26 15:32:49 UTC", "ExecMainStartTimestampMonotonic": "229619685", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[Mon 2021-07-26 15:32:49 UTC] ; stop_time=[n/a] ; pid=8804 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[Mon 2021-07-26 15:32:49 UTC] ; stop_time=[n/a] ; pid=8804 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngress 2021-07-26T15:33:05.181 INFO:teuthology.task.ansible.out:Packets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2021-07-26 15:32:49 UTC", "InactiveExitTimestampMonotonic": "229619905", "InvocationID": "c996f867e879405cb3d49a8d4db95787", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127777", "LimitSIGPENDINGSoft": "127777", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "8804", "MemoryAccounting": "yes", "MemoryCurrent": "53985280", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "contin 2021-07-26T15:33:05.182 INFO:teuthology.task.ansible.out:ue", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice docker.socket sysinit.target", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-07-26 15:32:51 UTC", "StateChangeTimestampMonotonic": "231632485", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "16", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": " 2021-07-26T15:33:05.184 INFO:teuthology.task.ansible.out:notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "Wants": "containerd.service network-online.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-07-26T15:33:05.941 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2021-07-26 15:32:51 UTC", "ActiveEnterTimestampMonotonic": "309566494", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "containerd.service network-online.target sysinit.target firewalld.service basic.target docker.socket system.slice systemd-journald.socket", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-07-26 15:32:49 UTC", "AssertTimestampMonotonic": "307594298", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-07-26 15:32:49 UTC", "ConditionTimestampMonotonic": "307594298", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.sli 2021-07-26T15:33:05.943 INFO:teuthology.task.ansible.out:ce/docker.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-firewall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8865", "ExecMainStartTimestamp": "Mon 2021-07-26 15:32:49 UTC", "ExecMainStartTimestampMonotonic": "307595001", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[Mon 2021-07-26 15:32:49 UTC] ; stop_time=[n/a] ; pid=8865 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[Mon 2021-07-26 15:32:49 UTC] ; stop_time=[n/a] ; pid=8865 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngress 2021-07-26T15:33:05.945 INFO:teuthology.task.ansible.out:Packets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2021-07-26 15:32:49 UTC", "InactiveExitTimestampMonotonic": "307595499", "InvocationID": "1d7833ea56ea4d50828e9bbed85d20a2", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127777", "LimitSIGPENDINGSoft": "127777", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "8865", "MemoryAccounting": "yes", "MemoryCurrent": "54079488", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "contin 2021-07-26T15:33:05.946 INFO:teuthology.task.ansible.out:ue", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice docker.socket", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-07-26 15:32:51 UTC", "StateChangeTimestampMonotonic": "309566494", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "15", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": " 2021-07-26T15:33:05.948 INFO:teuthology.task.ansible.out:notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "Wants": "network-online.target cont 2021-07-26T15:33:05.948 INFO:teuthology.task.ansible.out:ainerd.service", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-07-26T15:33:06.018 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2021-07-26T15:33:06.019 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2021-07-26T15:33:06.021 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched 2021-07-26T15:33:06.022 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-07-26T15:33:06.035 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* Monday 26 July 2021 15:33:06 +0000 (0:00:02.011) 0:03:43.590 *********** 2021-07-26T15:33:07.003 INFO:teuthology.task.ansible.out:ok: [smithi197.front.sepia.ceph.com] 2021-07-26T15:33:08.007 INFO:teuthology.task.ansible.out:ok: [smithi183.front.sepia.ceph.com] 2021-07-26T15:33:08.026 INFO:teuthology.task.ansible.out: TASK [Touch /ceph-qa-ready] **************************************************** 2021-07-26T15:33:08.028 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:33:08 +0000 (0:00:01.991) 0:03:45.581 *********** 2021-07-26T15:33:08.231 INFO:teuthology.task.ansible.out:changed: [smithi183.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-07-26T15:33:08.233 INFO:teuthology.task.ansible.out:changed: [smithi197.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-07-26T15:33:08.234 INFO:teuthology.task.ansible.out: PLAY RECAP ********************************************************************* smithi183.front.sepia.ceph.com : ok=133 changed=42 unreachable=0 failed=0 skipped=187 rescued=0 ignored=0 smithi197.front.sepia.ceph.com : ok=133 changed=42 unreachable=0 failed=0 skipped=187 rescued=0 ignored=0 Monday 26 July 2021 15:33:08 +0000 (0:00:00.207) 0:03:45.789 *********** =============================================================================== 2021-07-26T15:33:08.235 INFO:teuthology.task.ansible.out:Create all admin users with sudo access. ------------------------------- 28.31s testnode : Upgrade packages -------------------------------------------- 24.46s 2021-07-26T15:33:08.235 INFO:teuthology.task.ansible.out:users : Update authorized_keys using the keys repo --------------------- 20.62s container-host : Install container packages ---------------------------- 16.00s testnode : Install packages -------------------------------------------- 13.65s testnode : Ensure packages are not present. ---------------------------- 11.51s testnode : Zap all non-root disks --------------------------------------- 7.55s Remove revoked users ---------------------------------------------------- 6.98s common : Update apt cache ----------------------------------------------- 4.66s container-host : Install registries-conf-ctl ---------------------------- 4.23s testnode : Install packages via pip ------------------------------------- 2.31s Gathering Facts --------------------------------------------------------- 2.28s testnode : Update apt cache. -------------------------------------------- 2.13s testnode : Create logical volume(s) ------------------------------------- 2.05s container-host : Restart docker service --------------------------------- 2.01s Gathering Facts --------------------------------------------------------- 1.99s testnode : Install apt keys --------------------------------------------- 1.96s users : Update authorized_keys for each user with literal keys ---------- 1.36s common : Mask sleep units -------------------- 2021-07-26T15:33:08.237 INFO:teuthology.task.ansible.out:--------------------------- 1.18s testnode : Blow away lingering OSD data and FSIDs ----------------------- 1.15s 2021-07-26T15:33:08.613 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi183.front.sepia.ceph.com'), Remote(name='ubuntu@smithi197.front.sepia.ceph.com')] 2021-07-26T15:33:08.614 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-26T15:33:08.616 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-26T15:33:08.675 DEBUG:teuthology.orchestra.run.smithi183:> true 2021-07-26T15:33:08.796 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-26T15:33:08.797 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi197.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-26T15:33:08.849 DEBUG:teuthology.orchestra.run.smithi197:> true 2021-07-26T15:33:08.964 INFO:teuthology.run_tasks:Running task clock... 2021-07-26T15:33:08.979 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2021-07-26T15:33:08.979 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-07-26T15:33:08.981 DEBUG:teuthology.orchestra.run.smithi183:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-07-26T15:33:09.017 INFO:teuthology.orchestra.run.smithi183.stdout:26 Jul 15:33:09 ntpd[10174]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-07-26T15:33:09.018 INFO:teuthology.orchestra.run.smithi183.stdout:26 Jul 15:33:09 ntpd[10174]: Command line: ntpd -gq 2021-07-26T15:33:09.018 INFO:teuthology.orchestra.run.smithi183.stdout:26 Jul 15:33:09 ntpd[10174]: proto: precision = 0.259 usec (-22) 2021-07-26T15:33:09.019 INFO:teuthology.orchestra.run.smithi183.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-07-26T15:33:09.020 INFO:teuthology.orchestra.run.smithi183.stdout:26 Jul 15:33:09 ntpd[10174]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-07-26T15:33:09.020 INFO:teuthology.orchestra.run.smithi183.stdout:26 Jul 15:33:09 ntpd[10174]: restrict ::: KOD does nothing without LIMITED. 2021-07-26T15:33:09.021 INFO:teuthology.orchestra.run.smithi183.stderr:restrict ::: KOD does nothing without LIMITED. 2021-07-26T15:33:09.022 INFO:teuthology.orchestra.run.smithi183.stdout:26 Jul 15:33:09 ntpd[10174]: Listen and drop on 0 v6wildcard [::]:123 2021-07-26T15:33:09.022 INFO:teuthology.orchestra.run.smithi183.stdout:26 Jul 15:33:09 ntpd[10174]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-07-26T15:33:09.023 INFO:teuthology.orchestra.run.smithi183.stdout:26 Jul 15:33:09 ntpd[10174]: Listen normally on 2 lo 127.0.0.1:123 2021-07-26T15:33:09.023 INFO:teuthology.orchestra.run.smithi183.stdout:26 Jul 15:33:09 ntpd[10174]: Listen normally on 3 enp3s0f1 172.21.15.183:123 2021-07-26T15:33:09.023 INFO:teuthology.orchestra.run.smithi183.stdout:26 Jul 15:33:09 ntpd[10174]: Listen normally on 4 lo [::1]:123 2021-07-26T15:33:09.023 INFO:teuthology.orchestra.run.smithi183.stdout:26 Jul 15:33:09 ntpd[10174]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:8085%5]:123 2021-07-26T15:33:09.024 INFO:teuthology.orchestra.run.smithi183.stdout:26 Jul 15:33:09 ntpd[10174]: Listening on routing socket on fd #22 for interface updates 2021-07-26T15:33:10.018 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:10 ntpd[10174]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:33:10.018 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:10 ntpd[10174]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:33:10.019 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:10 ntpd[10174]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:33:10.019 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:10 ntpd[10174]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:33:10.019 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:10 ntpd[10174]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:33:10.019 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:10 ntpd[10174]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:33:11.018 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:11 ntpd[10174]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:33:11.019 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:11 ntpd[10174]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:33:11.019 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:11 ntpd[10174]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:33:11.019 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:11 ntpd[10174]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:33:11.020 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:11 ntpd[10174]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:33:11.020 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:11 ntpd[10174]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:33:12.019 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:12 ntpd[10174]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:33:12.020 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:12 ntpd[10174]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:33:12.020 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:12 ntpd[10174]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:33:12.020 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:12 ntpd[10174]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:33:12.020 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:12 ntpd[10174]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:33:12.021 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:12 ntpd[10174]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:33:12.021 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:12 ntpd[10174]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:33:12.021 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:12 ntpd[10174]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:33:12.021 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:12 ntpd[10174]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:33:12.022 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:12 ntpd[10174]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:33:12.022 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:12 ntpd[10174]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:33:12.022 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:12 ntpd[10174]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:33:13.020 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:13 ntpd[10174]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:33:13.020 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:13 ntpd[10174]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:33:13.020 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:13 ntpd[10174]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:33:13.021 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:13 ntpd[10174]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:33:13.021 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:13 ntpd[10174]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:33:13.021 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:13 ntpd[10174]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:33:13.021 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:13 ntpd[10174]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:33:13.022 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:13 ntpd[10174]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:33:13.022 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:13 ntpd[10174]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:33:13.022 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:13 ntpd[10174]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:33:13.022 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:13 ntpd[10174]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:33:13.022 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:13 ntpd[10174]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:33:14.019 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:14 ntpd[10174]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:33:14.019 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:14 ntpd[10174]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:33:14.019 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:14 ntpd[10174]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:33:14.020 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:14 ntpd[10174]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:33:14.020 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:14 ntpd[10174]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:33:14.020 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:14 ntpd[10174]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:33:14.021 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:14 ntpd[10174]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:33:14.021 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:14 ntpd[10174]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:33:14.021 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:14 ntpd[10174]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:33:14.021 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:14 ntpd[10174]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:33:14.022 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:14 ntpd[10174]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:33:14.022 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:14 ntpd[10174]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:33:15.019 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:15 ntpd[10174]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:33:15.019 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:15 ntpd[10174]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:33:15.019 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:15 ntpd[10174]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:33:15.019 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:15 ntpd[10174]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:33:15.020 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:15 ntpd[10174]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:33:15.020 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:15 ntpd[10174]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:33:15.020 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:15 ntpd[10174]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:33:15.020 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:15 ntpd[10174]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:33:15.021 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:15 ntpd[10174]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:33:15.021 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:15 ntpd[10174]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:33:15.021 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:15 ntpd[10174]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:33:15.021 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:15 ntpd[10174]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:33:16.020 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:16 ntpd[10174]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:33:16.020 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:16 ntpd[10174]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:33:16.021 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:16 ntpd[10174]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:33:16.021 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:16 ntpd[10174]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:33:16.021 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:16 ntpd[10174]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:33:16.021 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:16 ntpd[10174]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:33:16.022 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:16 ntpd[10174]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:33:16.022 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:16 ntpd[10174]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:33:16.022 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:16 ntpd[10174]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:33:16.023 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:16 ntpd[10174]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:33:16.023 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:16 ntpd[10174]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:33:16.023 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:16 ntpd[10174]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:33:16.024 INFO:teuthology.orchestra.run.smithi183.stdout:26 Jul 15:33:16 ntpd[10174]: ntpd: time slew +0.008627 s 2021-07-26T15:33:16.024 INFO:teuthology.orchestra.run.smithi183.stdout:ntpd: time slew +0.008627s 2021-07-26T15:33:16.025 INFO:teuthology.orchestra.run.smithi183.stderr:26 Jul 15:33:16 ntpd[10174]: can't open /var/log/ntpstats/loopstats.20210726: Permission denied 2021-07-26T15:33:16.073 INFO:teuthology.orchestra.run.smithi183.stdout: remote refid st t when poll reach delay offset jitter 2021-07-26T15:33:16.073 INFO:teuthology.orchestra.run.smithi183.stdout:============================================================================== 2021-07-26T15:33:16.074 INFO:teuthology.orchestra.run.smithi183.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-07-26T15:33:16.074 INFO:teuthology.orchestra.run.smithi183.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-07-26T15:33:16.074 INFO:teuthology.orchestra.run.smithi183.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-07-26T15:33:16.074 INFO:teuthology.orchestra.run.smithi183.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-07-26T15:33:16.075 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-07-26T15:33:16.075 DEBUG:teuthology.orchestra.run.smithi197:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-07-26T15:33:16.108 INFO:teuthology.orchestra.run.smithi197.stdout:26 Jul 15:33:16 ntpd[10235]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-07-26T15:33:16.108 INFO:teuthology.orchestra.run.smithi197.stdout:26 Jul 15:33:16 ntpd[10235]: Command line: ntpd -gq 2021-07-26T15:33:16.109 INFO:teuthology.orchestra.run.smithi197.stdout:26 Jul 15:33:16 ntpd[10235]: proto: precision = 0.207 usec (-22) 2021-07-26T15:33:16.109 INFO:teuthology.orchestra.run.smithi197.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-07-26T15:33:16.110 INFO:teuthology.orchestra.run.smithi197.stdout:26 Jul 15:33:16 ntpd[10235]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-07-26T15:33:16.111 INFO:teuthology.orchestra.run.smithi197.stderr:restrict ::: KOD does nothing without LIMITED. 2021-07-26T15:33:16.112 INFO:teuthology.orchestra.run.smithi197.stdout:26 Jul 15:33:16 ntpd[10235]: restrict ::: KOD does nothing without LIMITED. 2021-07-26T15:33:16.112 INFO:teuthology.orchestra.run.smithi197.stdout:26 Jul 15:33:16 ntpd[10235]: Listen and drop on 0 v6wildcard [::]:123 2021-07-26T15:33:16.112 INFO:teuthology.orchestra.run.smithi197.stdout:26 Jul 15:33:16 ntpd[10235]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-07-26T15:33:16.113 INFO:teuthology.orchestra.run.smithi197.stdout:26 Jul 15:33:16 ntpd[10235]: Listen normally on 2 lo 127.0.0.1:123 2021-07-26T15:33:16.113 INFO:teuthology.orchestra.run.smithi197.stdout:26 Jul 15:33:16 ntpd[10235]: Listen normally on 3 enp3s0f1 172.21.15.197:123 2021-07-26T15:33:16.113 INFO:teuthology.orchestra.run.smithi197.stdout:26 Jul 15:33:16 ntpd[10235]: Listen normally on 4 lo [::1]:123 2021-07-26T15:33:16.113 INFO:teuthology.orchestra.run.smithi197.stdout:26 Jul 15:33:16 ntpd[10235]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7d1f%5]:123 2021-07-26T15:33:16.114 INFO:teuthology.orchestra.run.smithi197.stdout:26 Jul 15:33:16 ntpd[10235]: Listening on routing socket on fd #22 for interface updates 2021-07-26T15:33:17.110 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:17 ntpd[10235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:33:17.111 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:17 ntpd[10235]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:33:17.111 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:17 ntpd[10235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:33:17.111 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:17 ntpd[10235]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:33:17.112 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:17 ntpd[10235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:33:17.112 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:17 ntpd[10235]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:33:17.112 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:17 ntpd[10235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:33:17.113 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:17 ntpd[10235]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:33:17.113 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:17 ntpd[10235]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:33:17.114 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:17 ntpd[10235]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:33:17.114 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:17 ntpd[10235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:33:17.114 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:17 ntpd[10235]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:33:17.115 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:17 ntpd[10235]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:33:17.115 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:17 ntpd[10235]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:33:17.115 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:17 ntpd[10235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:33:17.116 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:17 ntpd[10235]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:33:17.116 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:17 ntpd[10235]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:33:17.116 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:17 ntpd[10235]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:33:19.110 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:19 ntpd[10235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:33:19.111 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:19 ntpd[10235]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:33:19.111 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:19 ntpd[10235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:33:19.111 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:19 ntpd[10235]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:33:19.111 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:19 ntpd[10235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:33:19.112 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:19 ntpd[10235]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:33:19.112 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:19 ntpd[10235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:33:19.112 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:19 ntpd[10235]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:33:19.112 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:19 ntpd[10235]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:33:19.113 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:19 ntpd[10235]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:33:19.113 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:19 ntpd[10235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:33:19.113 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:19 ntpd[10235]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:33:19.113 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:19 ntpd[10235]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:33:19.113 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:19 ntpd[10235]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:33:19.114 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:19 ntpd[10235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:33:19.114 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:19 ntpd[10235]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:33:19.114 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:19 ntpd[10235]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:33:19.114 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:19 ntpd[10235]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:33:21.110 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:21 ntpd[10235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:33:21.111 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:21 ntpd[10235]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:33:21.111 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:21 ntpd[10235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:33:21.111 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:21 ntpd[10235]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:33:21.111 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:21 ntpd[10235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:33:21.112 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:21 ntpd[10235]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:33:21.112 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:21 ntpd[10235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:33:21.112 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:21 ntpd[10235]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:33:21.112 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:21 ntpd[10235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:33:21.113 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:21 ntpd[10235]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:33:21.113 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:21 ntpd[10235]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:33:21.113 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:21 ntpd[10235]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:33:21.113 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:21 ntpd[10235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:33:21.113 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:21 ntpd[10235]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:33:21.114 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:21 ntpd[10235]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:33:21.114 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:21 ntpd[10235]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:33:21.114 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:21 ntpd[10235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:33:21.114 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:21 ntpd[10235]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:33:21.115 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:21 ntpd[10235]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:33:21.115 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:21 ntpd[10235]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:33:21.115 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:21 ntpd[10235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:33:21.115 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:21 ntpd[10235]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:33:21.116 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:21 ntpd[10235]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:33:21.116 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:21 ntpd[10235]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:33:23.110 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:23 ntpd[10235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:33:23.111 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:23 ntpd[10235]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:33:23.111 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:23 ntpd[10235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:33:23.111 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:23 ntpd[10235]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:33:23.111 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:23 ntpd[10235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:33:23.111 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:23 ntpd[10235]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:33:23.112 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:23 ntpd[10235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:33:23.112 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:23 ntpd[10235]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:33:23.112 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:23 ntpd[10235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:33:23.112 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:23 ntpd[10235]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:33:23.113 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:23 ntpd[10235]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:33:23.113 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:23 ntpd[10235]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:33:23.114 INFO:teuthology.orchestra.run.smithi197.stdout:26 Jul 15:33:23 ntpd[10235]: ntpd: time slew -0.001613 s 2021-07-26T15:33:23.114 INFO:teuthology.orchestra.run.smithi197.stdout:ntpd: time slew -0.001613s 2021-07-26T15:33:23.114 INFO:teuthology.orchestra.run.smithi197.stderr:26 Jul 15:33:23 ntpd[10235]: can't open /var/log/ntpstats/loopstats.20210726: Permission denied 2021-07-26T15:33:23.166 INFO:teuthology.orchestra.run.smithi197.stdout: remote refid st t when poll reach delay offset jitter 2021-07-26T15:33:23.167 INFO:teuthology.orchestra.run.smithi197.stdout:============================================================================== 2021-07-26T15:33:23.167 INFO:teuthology.orchestra.run.smithi197.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-07-26T15:33:23.167 INFO:teuthology.orchestra.run.smithi197.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-07-26T15:33:23.168 INFO:teuthology.orchestra.run.smithi197.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-07-26T15:33:23.168 INFO:teuthology.orchestra.run.smithi197.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-07-26T15:33:23.168 INFO:teuthology.run_tasks:Running task install... 2021-07-26T15:33:23.184 DEBUG:teuthology.task.install:project ceph 2021-07-26T15:33:23.185 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'branch': 'octopus', 'sha1': 'bccf07c244ef1754a7e8d345570b6a04f2ee5a7e'}} 2021-07-26T15:33:23.185 DEBUG:teuthology.task.install:config {'branch': 'octopus', 'sha1': 'bccf07c244ef1754a7e8d345570b6a04f2ee5a7e'} 2021-07-26T15:33:23.186 INFO:teuthology.task.install:Using flavor: basic 2021-07-26T15:33:23.193 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2021-07-26T15:33:23.194 INFO:teuthology.task.install:extra packages: [] 2021-07-26T15:33:23.195 DEBUG:teuthology.orchestra.run.smithi183:> sudo lsb_release -is 2021-07-26T15:33:23.247 INFO:teuthology.orchestra.run.smithi183.stdout:Ubuntu 2021-07-26T15:33:23.252 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-07-26T15:33:23.253 DEBUG:teuthology.orchestra.run.smithi197:> sudo lsb_release -is 2021-07-26T15:33:23.253 DEBUG:teuthology.orchestra.run.smithi183:> sudo apt-key list | grep Ceph 2021-07-26T15:33:23.303 INFO:teuthology.orchestra.run.smithi197.stdout:Ubuntu 2021-07-26T15:33:23.307 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-07-26T15:33:23.308 DEBUG:teuthology.orchestra.run.smithi197:> sudo apt-key list | grep Ceph 2021-07-26T15:33:23.349 INFO:teuthology.orchestra.run.smithi183.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-07-26T15:33:23.405 INFO:teuthology.orchestra.run.smithi197.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-07-26T15:33:23.409 INFO:teuthology.orchestra.run.smithi183.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-07-26T15:33:23.409 INFO:teuthology.orchestra.run.smithi183.stdout:uid [ unknown] Ceph.com (release key) 2021-07-26T15:33:23.410 DEBUG:teuthology.orchestra.run.smithi183:> sudo lsb_release -is 2021-07-26T15:33:23.458 INFO:teuthology.orchestra.run.smithi183.stdout:Ubuntu 2021-07-26T15:33:23.462 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-07-26T15:33:23.462 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2021-07-26T15:33:23.463 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-07-26T15:33:23.463 INFO:teuthology.packaging:ref: None 2021-07-26T15:33:23.463 INFO:teuthology.packaging:tag: None 2021-07-26T15:33:23.464 INFO:teuthology.packaging:branch: octopus 2021-07-26T15:33:23.464 INFO:teuthology.packaging:sha1: bccf07c244ef1754a7e8d345570b6a04f2ee5a7e 2021-07-26T15:33:23.464 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=octopus 2021-07-26T15:33:23.470 INFO:teuthology.orchestra.run.smithi197.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-07-26T15:33:23.470 INFO:teuthology.orchestra.run.smithi197.stdout:uid [ unknown] Ceph.com (release key) 2021-07-26T15:33:23.470 DEBUG:teuthology.orchestra.run.smithi197:> sudo lsb_release -is 2021-07-26T15:33:23.516 INFO:teuthology.orchestra.run.smithi197.stdout:Ubuntu 2021-07-26T15:33:23.521 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-07-26T15:33:23.522 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2021-07-26T15:33:23.522 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-07-26T15:33:23.522 INFO:teuthology.packaging:ref: None 2021-07-26T15:33:23.522 INFO:teuthology.packaging:tag: None 2021-07-26T15:33:23.523 INFO:teuthology.packaging:branch: octopus 2021-07-26T15:33:23.523 INFO:teuthology.packaging:sha1: bccf07c244ef1754a7e8d345570b6a04f2ee5a7e 2021-07-26T15:33:23.524 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=octopus 2021-07-26T15:33:23.727 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default/ 2021-07-26T15:33:23.728 INFO:teuthology.task.install.deb:Package version is 15.2.13-213-g0f589fd5-1focal 2021-07-26T15:33:23.791 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default/ 2021-07-26T15:33:23.791 INFO:teuthology.task.install.deb:Package version is 15.2.13-213-g0f589fd5-1focal 2021-07-26T15:33:23.876 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2021-07-26T15:33:23.876 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-07-26T15:33:23.894 DEBUG:teuthology.orchestra.run.smithi183:> sudo apt-get update 2021-07-26T15:33:23.929 DEBUG:teuthology.orchestra.run.smithi197:> set -ex 2021-07-26T15:33:23.929 DEBUG:teuthology.orchestra.run.smithi197:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-07-26T15:33:23.946 DEBUG:teuthology.orchestra.run.smithi197:> sudo apt-get update 2021-07-26T15:33:24.033 INFO:teuthology.orchestra.run.smithi183.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-07-26T15:33:24.121 INFO:teuthology.orchestra.run.smithi183.stdout:Ign:2 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal InRelease 2021-07-26T15:33:24.133 INFO:teuthology.orchestra.run.smithi197.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-07-26T15:33:24.151 INFO:teuthology.orchestra.run.smithi183.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal InRelease 2021-07-26T15:33:24.173 INFO:teuthology.orchestra.run.smithi183.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal Release [7,680 B] 2021-07-26T15:33:24.196 INFO:teuthology.orchestra.run.smithi197.stdout:Ign:2 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal InRelease 2021-07-26T15:33:24.198 INFO:teuthology.orchestra.run.smithi183.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal Release.gpg 2021-07-26T15:33:24.221 INFO:teuthology.orchestra.run.smithi197.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal Release [7,680 B] 2021-07-26T15:33:24.233 INFO:teuthology.orchestra.run.smithi183.stdout:Hit:6 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-07-26T15:33:24.236 INFO:teuthology.orchestra.run.smithi183.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 Packages [15.8 kB] 2021-07-26T15:33:24.246 INFO:teuthology.orchestra.run.smithi197.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal Release.gpg 2021-07-26T15:33:24.249 INFO:teuthology.orchestra.run.smithi197.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal InRelease 2021-07-26T15:33:24.271 INFO:teuthology.orchestra.run.smithi197.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 Packages [15.8 kB] 2021-07-26T15:33:24.324 INFO:teuthology.orchestra.run.smithi183.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-07-26T15:33:24.334 INFO:teuthology.orchestra.run.smithi197.stdout:Hit:7 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-07-26T15:33:24.420 INFO:teuthology.orchestra.run.smithi197.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-07-26T15:33:30.953 INFO:teuthology.orchestra.run.smithi197.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main i386 Packages [3,062 B] 2021-07-26T15:33:30.955 INFO:teuthology.orchestra.run.smithi183.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main i386 Packages [3,062 B] 2021-07-26T15:33:31.044 INFO:teuthology.orchestra.run.smithi197.stdout:Fetched 127 kB in 7s (18.4 kB/s) 2021-07-26T15:33:31.049 INFO:teuthology.orchestra.run.smithi183.stdout:Fetched 127 kB in 7s (18.2 kB/s) 2021-07-26T15:33:31.800 INFO:teuthology.orchestra.run.smithi197.stdout:Reading package lists... 2021-07-26T15:33:31.805 INFO:teuthology.orchestra.run.smithi183.stdout:Reading package lists... 2021-07-26T15:33:31.821 DEBUG:teuthology.orchestra.run.smithi197:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.13-213-g0f589fd5-1focal cephadm=15.2.13-213-g0f589fd5-1focal ceph-mds=15.2.13-213-g0f589fd5-1focal ceph-mgr=15.2.13-213-g0f589fd5-1focal ceph-common=15.2.13-213-g0f589fd5-1focal ceph-fuse=15.2.13-213-g0f589fd5-1focal ceph-test=15.2.13-213-g0f589fd5-1focal radosgw=15.2.13-213-g0f589fd5-1focal python3-rados=15.2.13-213-g0f589fd5-1focal python3-rgw=15.2.13-213-g0f589fd5-1focal python3-cephfs=15.2.13-213-g0f589fd5-1focal python3-rbd=15.2.13-213-g0f589fd5-1focal libcephfs2=15.2.13-213-g0f589fd5-1focal libcephfs-dev=15.2.13-213-g0f589fd5-1focal librados2=15.2.13-213-g0f589fd5-1focal librbd1=15.2.13-213-g0f589fd5-1focal rbd-fuse=15.2.13-213-g0f589fd5-1focal 2021-07-26T15:33:31.829 DEBUG:teuthology.orchestra.run.smithi183:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.13-213-g0f589fd5-1focal cephadm=15.2.13-213-g0f589fd5-1focal ceph-mds=15.2.13-213-g0f589fd5-1focal ceph-mgr=15.2.13-213-g0f589fd5-1focal ceph-common=15.2.13-213-g0f589fd5-1focal ceph-fuse=15.2.13-213-g0f589fd5-1focal ceph-test=15.2.13-213-g0f589fd5-1focal radosgw=15.2.13-213-g0f589fd5-1focal python3-rados=15.2.13-213-g0f589fd5-1focal python3-rgw=15.2.13-213-g0f589fd5-1focal python3-cephfs=15.2.13-213-g0f589fd5-1focal python3-rbd=15.2.13-213-g0f589fd5-1focal libcephfs2=15.2.13-213-g0f589fd5-1focal libcephfs-dev=15.2.13-213-g0f589fd5-1focal librados2=15.2.13-213-g0f589fd5-1focal librbd1=15.2.13-213-g0f589fd5-1focal rbd-fuse=15.2.13-213-g0f589fd5-1focal 2021-07-26T15:33:31.892 INFO:teuthology.orchestra.run.smithi197.stdout:Reading package lists... 2021-07-26T15:33:31.893 INFO:teuthology.orchestra.run.smithi183.stdout:Reading package lists... 2021-07-26T15:33:32.054 INFO:teuthology.orchestra.run.smithi183.stdout:Building dependency tree... 2021-07-26T15:33:32.055 INFO:teuthology.orchestra.run.smithi183.stdout:Reading state information... 2021-07-26T15:33:32.056 INFO:teuthology.orchestra.run.smithi197.stdout:Building dependency tree... 2021-07-26T15:33:32.056 INFO:teuthology.orchestra.run.smithi197.stdout:Reading state information... 2021-07-26T15:33:32.188 INFO:teuthology.orchestra.run.smithi197.stdout:The following packages were automatically installed and are no longer required: 2021-07-26T15:33:32.191 INFO:teuthology.orchestra.run.smithi197.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2021-07-26T15:33:32.191 INFO:teuthology.orchestra.run.smithi197.stdout:Use 'sudo apt autoremove' to remove them. 2021-07-26T15:33:32.192 INFO:teuthology.orchestra.run.smithi197.stdout:The following additional packages will be installed: 2021-07-26T15:33:32.192 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-07-26T15:33:32.192 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-07-26T15:33:32.192 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-mon ceph-osd jq libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 2021-07-26T15:33:32.192 INFO:teuthology.orchestra.run.smithi197.stdout: libleveldb1d liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 2021-07-26T15:33:32.193 INFO:teuthology.orchestra.run.smithi197.stdout: librdkafka1 librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl 2021-07-26T15:33:32.193 INFO:teuthology.orchestra.run.smithi197.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2021-07-26T15:33:32.193 INFO:teuthology.orchestra.run.smithi197.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2021-07-26T15:33:32.193 INFO:teuthology.orchestra.run.smithi197.stdout: python3-cherrypy3 python3-cryptography python3-decorator python3-google-auth 2021-07-26T15:33:32.194 INFO:teuthology.orchestra.run.smithi197.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2021-07-26T15:33:32.194 INFO:teuthology.orchestra.run.smithi197.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2021-07-26T15:33:32.194 INFO:teuthology.orchestra.run.smithi197.stdout: python3-markupsafe python3-oauthlib python3-openssl python3-packaging 2021-07-26T15:33:32.194 INFO:teuthology.orchestra.run.smithi197.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2021-07-26T15:33:32.195 INFO:teuthology.orchestra.run.smithi197.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2021-07-26T15:33:32.195 INFO:teuthology.orchestra.run.smithi197.stdout: python3-pyasn1-modules python3-pyinotify python3-pytest python3-repoze.lru 2021-07-26T15:33:32.195 INFO:teuthology.orchestra.run.smithi197.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-scipy 2021-07-26T15:33:32.195 INFO:teuthology.orchestra.run.smithi197.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2021-07-26T15:33:32.196 INFO:teuthology.orchestra.run.smithi197.stdout: python3-sklearn python3-sklearn-lib python3-soupsieve python3-tempita 2021-07-26T15:33:32.196 INFO:teuthology.orchestra.run.smithi197.stdout: python3-waitress python3-wcwidth python3-webencodings python3-webob 2021-07-26T15:33:32.196 INFO:teuthology.orchestra.run.smithi197.stdout: python3-websocket python3-webtest python3-werkzeug socat xmlstarlet 2021-07-26T15:33:32.198 INFO:teuthology.orchestra.run.smithi197.stdout:Suggested packages: 2021-07-26T15:33:32.198 INFO:teuthology.orchestra.run.smithi197.stdout: python3-influxdb python-attr-doc python-blinker-doc python-cryptography-doc 2021-07-26T15:33:32.198 INFO:teuthology.orchestra.run.smithi197.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2021-07-26T15:33:32.198 INFO:teuthology.orchestra.run.smithi197.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2021-07-26T15:33:32.199 INFO:teuthology.orchestra.run.smithi197.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2021-07-26T15:33:32.199 INFO:teuthology.orchestra.run.smithi197.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2021-07-26T15:33:32.199 INFO:teuthology.orchestra.run.smithi197.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2021-07-26T15:33:32.199 INFO:teuthology.orchestra.run.smithi197.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2021-07-26T15:33:32.199 INFO:teuthology.orchestra.run.smithi197.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2021-07-26T15:33:32.200 INFO:teuthology.orchestra.run.smithi197.stdout:Recommended packages: 2021-07-26T15:33:32.200 INFO:teuthology.orchestra.run.smithi197.stdout: btrfs-tools 2021-07-26T15:33:32.203 INFO:teuthology.orchestra.run.smithi183.stdout:The following packages were automatically installed and are no longer required: 2021-07-26T15:33:32.203 INFO:teuthology.orchestra.run.smithi183.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2021-07-26T15:33:32.204 INFO:teuthology.orchestra.run.smithi183.stdout:Use 'sudo apt autoremove' to remove them. 2021-07-26T15:33:32.204 INFO:teuthology.orchestra.run.smithi183.stdout:The following additional packages will be installed: 2021-07-26T15:33:32.204 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-07-26T15:33:32.204 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-07-26T15:33:32.204 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mon ceph-osd jq libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 2021-07-26T15:33:32.205 INFO:teuthology.orchestra.run.smithi183.stdout: libleveldb1d liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 2021-07-26T15:33:32.205 INFO:teuthology.orchestra.run.smithi183.stdout: librdkafka1 librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl 2021-07-26T15:33:32.205 INFO:teuthology.orchestra.run.smithi183.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2021-07-26T15:33:32.205 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2021-07-26T15:33:32.206 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cherrypy3 python3-cryptography python3-decorator python3-google-auth 2021-07-26T15:33:32.206 INFO:teuthology.orchestra.run.smithi183.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2021-07-26T15:33:32.206 INFO:teuthology.orchestra.run.smithi183.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2021-07-26T15:33:32.206 INFO:teuthology.orchestra.run.smithi183.stdout: python3-markupsafe python3-oauthlib python3-openssl python3-packaging 2021-07-26T15:33:32.207 INFO:teuthology.orchestra.run.smithi183.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2021-07-26T15:33:32.207 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2021-07-26T15:33:32.207 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyasn1-modules python3-pyinotify python3-pytest python3-repoze.lru 2021-07-26T15:33:32.208 INFO:teuthology.orchestra.run.smithi183.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-scipy 2021-07-26T15:33:32.208 INFO:teuthology.orchestra.run.smithi183.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2021-07-26T15:33:32.208 INFO:teuthology.orchestra.run.smithi183.stdout: python3-sklearn python3-sklearn-lib python3-soupsieve python3-tempita 2021-07-26T15:33:32.208 INFO:teuthology.orchestra.run.smithi183.stdout: python3-waitress python3-wcwidth python3-webencodings python3-webob 2021-07-26T15:33:32.208 INFO:teuthology.orchestra.run.smithi183.stdout: python3-websocket python3-webtest python3-werkzeug socat xmlstarlet 2021-07-26T15:33:32.209 INFO:teuthology.orchestra.run.smithi183.stdout:Suggested packages: 2021-07-26T15:33:32.209 INFO:teuthology.orchestra.run.smithi183.stdout: python3-influxdb python-attr-doc python-blinker-doc python-cryptography-doc 2021-07-26T15:33:32.209 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2021-07-26T15:33:32.209 INFO:teuthology.orchestra.run.smithi183.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2021-07-26T15:33:32.210 INFO:teuthology.orchestra.run.smithi183.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2021-07-26T15:33:32.210 INFO:teuthology.orchestra.run.smithi183.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2021-07-26T15:33:32.210 INFO:teuthology.orchestra.run.smithi183.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2021-07-26T15:33:32.210 INFO:teuthology.orchestra.run.smithi183.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2021-07-26T15:33:32.210 INFO:teuthology.orchestra.run.smithi183.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2021-07-26T15:33:32.211 INFO:teuthology.orchestra.run.smithi183.stdout:Recommended packages: 2021-07-26T15:33:32.211 INFO:teuthology.orchestra.run.smithi183.stdout: btrfs-tools 2021-07-26T15:33:32.282 INFO:teuthology.orchestra.run.smithi197.stdout:The following NEW packages will be installed: 2021-07-26T15:33:32.282 INFO:teuthology.orchestra.run.smithi197.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-07-26T15:33:32.283 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-07-26T15:33:32.283 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-07-26T15:33:32.283 INFO:teuthology.orchestra.run.smithi197.stdout: ceph-mon ceph-osd ceph-test cephadm jq libcephfs-dev libcephfs2 libjq1 2021-07-26T15:33:32.283 INFO:teuthology.orchestra.run.smithi197.stdout: libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d liblttng-ust0 2021-07-26T15:33:32.284 INFO:teuthology.orchestra.run.smithi197.stdout: liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2021-07-26T15:33:32.284 INFO:teuthology.orchestra.run.smithi197.stdout: libxslt1.1 nvme-cli python-pastedeploy-tpl python3-atomicwrites python3-attr 2021-07-26T15:33:32.284 INFO:teuthology.orchestra.run.smithi197.stdout: python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2021-07-26T15:33:32.284 INFO:teuthology.orchestra.run.smithi197.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2021-07-26T15:33:32.285 INFO:teuthology.orchestra.run.smithi197.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2021-07-26T15:33:32.285 INFO:teuthology.orchestra.run.smithi197.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2021-07-26T15:33:32.285 INFO:teuthology.orchestra.run.smithi197.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2021-07-26T15:33:32.285 INFO:teuthology.orchestra.run.smithi197.stdout: python3-oauthlib python3-openssl python3-packaging python3-paste 2021-07-26T15:33:32.285 INFO:teuthology.orchestra.run.smithi197.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-pluggy 2021-07-26T15:33:32.286 INFO:teuthology.orchestra.run.smithi197.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2021-07-26T15:33:32.286 INFO:teuthology.orchestra.run.smithi197.stdout: python3-pyasn1-modules python3-pyinotify python3-pytest python3-rados 2021-07-26T15:33:32.286 INFO:teuthology.orchestra.run.smithi197.stdout: python3-rbd python3-repoze.lru python3-requests-oauthlib python3-rgw 2021-07-26T15:33:32.286 INFO:teuthology.orchestra.run.smithi197.stdout: python3-routes python3-rsa python3-scipy python3-simplegeneric 2021-07-26T15:33:32.287 INFO:teuthology.orchestra.run.smithi197.stdout: python3-simplejson python3-singledispatch python3-sklearn 2021-07-26T15:33:32.287 INFO:teuthology.orchestra.run.smithi197.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2021-07-26T15:33:32.288 INFO:teuthology.orchestra.run.smithi197.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2021-07-26T15:33:32.288 INFO:teuthology.orchestra.run.smithi197.stdout: python3-webtest python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2021-07-26T15:33:32.289 INFO:teuthology.orchestra.run.smithi197.stdout:The following packages will be upgraded: 2021-07-26T15:33:32.289 INFO:teuthology.orchestra.run.smithi197.stdout: librados2 librbd1 2021-07-26T15:33:32.291 INFO:teuthology.orchestra.run.smithi183.stdout:The following NEW packages will be installed: 2021-07-26T15:33:32.291 INFO:teuthology.orchestra.run.smithi183.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-07-26T15:33:32.291 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-07-26T15:33:32.292 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-07-26T15:33:32.292 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mon ceph-osd ceph-test cephadm jq libcephfs-dev libcephfs2 libjq1 2021-07-26T15:33:32.292 INFO:teuthology.orchestra.run.smithi183.stdout: libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d liblttng-ust0 2021-07-26T15:33:32.292 INFO:teuthology.orchestra.run.smithi183.stdout: liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2021-07-26T15:33:32.293 INFO:teuthology.orchestra.run.smithi183.stdout: libxslt1.1 nvme-cli python-pastedeploy-tpl python3-atomicwrites python3-attr 2021-07-26T15:33:32.293 INFO:teuthology.orchestra.run.smithi183.stdout: python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2021-07-26T15:33:32.293 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2021-07-26T15:33:32.293 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2021-07-26T15:33:32.293 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2021-07-26T15:33:32.294 INFO:teuthology.orchestra.run.smithi183.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2021-07-26T15:33:32.294 INFO:teuthology.orchestra.run.smithi183.stdout: python3-oauthlib python3-openssl python3-packaging python3-paste 2021-07-26T15:33:32.294 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-pluggy 2021-07-26T15:33:32.294 INFO:teuthology.orchestra.run.smithi183.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2021-07-26T15:33:32.295 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyasn1-modules python3-pyinotify python3-pytest python3-rados 2021-07-26T15:33:32.295 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rbd python3-repoze.lru python3-requests-oauthlib python3-rgw 2021-07-26T15:33:32.295 INFO:teuthology.orchestra.run.smithi183.stdout: python3-routes python3-rsa python3-scipy python3-simplegeneric 2021-07-26T15:33:32.295 INFO:teuthology.orchestra.run.smithi183.stdout: python3-simplejson python3-singledispatch python3-sklearn 2021-07-26T15:33:32.295 INFO:teuthology.orchestra.run.smithi183.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2021-07-26T15:33:32.296 INFO:teuthology.orchestra.run.smithi183.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2021-07-26T15:33:32.296 INFO:teuthology.orchestra.run.smithi183.stdout: python3-webtest python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2021-07-26T15:33:32.296 INFO:teuthology.orchestra.run.smithi183.stdout:The following packages will be upgraded: 2021-07-26T15:33:32.297 INFO:teuthology.orchestra.run.smithi183.stdout: librados2 librbd1 2021-07-26T15:33:32.461 INFO:teuthology.orchestra.run.smithi197.stdout:2 upgraded, 97 newly installed, 0 to remove and 143 not upgraded. 2021-07-26T15:33:32.461 INFO:teuthology.orchestra.run.smithi197.stdout:Need to get 153 MB of archives. 2021-07-26T15:33:32.461 INFO:teuthology.orchestra.run.smithi197.stdout:After this operation, 697 MB of additional disk space will be used. 2021-07-26T15:33:32.462 INFO:teuthology.orchestra.run.smithi197.stdout:Get:1 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 15.2.13-213-g0f589fd5-1focal [1,694 kB] 2021-07-26T15:33:32.463 INFO:teuthology.orchestra.run.smithi183.stdout:2 upgraded, 97 newly installed, 0 to remove and 143 not upgraded. 2021-07-26T15:33:32.464 INFO:teuthology.orchestra.run.smithi183.stdout:Need to get 153 MB of archives. 2021-07-26T15:33:32.464 INFO:teuthology.orchestra.run.smithi183.stdout:After this operation, 697 MB of additional disk space will be used. 2021-07-26T15:33:32.464 INFO:teuthology.orchestra.run.smithi183.stdout:Get:1 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 15.2.13-213-g0f589fd5-1focal [1,694 kB] 2021-07-26T15:33:32.472 INFO:teuthology.orchestra.run.smithi197.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2021-07-26T15:33:32.479 INFO:teuthology.orchestra.run.smithi183.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2021-07-26T15:33:32.760 INFO:teuthology.orchestra.run.smithi183.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 15.2.13-213-g0f589fd5-1focal [3,247 kB] 2021-07-26T15:33:32.850 INFO:teuthology.orchestra.run.smithi197.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2021-07-26T15:33:32.855 INFO:teuthology.orchestra.run.smithi183.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2021-07-26T15:33:32.856 INFO:teuthology.orchestra.run.smithi183.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2021-07-26T15:33:32.859 INFO:teuthology.orchestra.run.smithi197.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2021-07-26T15:33:32.860 INFO:teuthology.orchestra.run.smithi197.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2021-07-26T15:33:32.861 INFO:teuthology.orchestra.run.smithi183.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2021-07-26T15:33:32.986 INFO:teuthology.orchestra.run.smithi197.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 15.2.13-213-g0f589fd5-1focal [3,247 kB] 2021-07-26T15:33:32.993 INFO:teuthology.orchestra.run.smithi183.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2021-07-26T15:33:33.003 INFO:teuthology.orchestra.run.smithi197.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2021-07-26T15:33:33.036 INFO:teuthology.orchestra.run.smithi197.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2021-07-26T15:33:33.040 INFO:teuthology.orchestra.run.smithi183.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2021-07-26T15:33:33.041 INFO:teuthology.orchestra.run.smithi197.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2021-07-26T15:33:33.048 INFO:teuthology.orchestra.run.smithi183.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2021-07-26T15:33:33.074 INFO:teuthology.orchestra.run.smithi197.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2021-07-26T15:33:33.080 INFO:teuthology.orchestra.run.smithi197.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2021-07-26T15:33:33.081 INFO:teuthology.orchestra.run.smithi183.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2021-07-26T15:33:33.084 INFO:teuthology.orchestra.run.smithi197.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2021-07-26T15:33:33.088 INFO:teuthology.orchestra.run.smithi183.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2021-07-26T15:33:33.092 INFO:teuthology.orchestra.run.smithi183.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2021-07-26T15:33:33.104 INFO:teuthology.orchestra.run.smithi197.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jwt all 1.7.1-2ubuntu2 [17.4 kB] 2021-07-26T15:33:33.105 INFO:teuthology.orchestra.run.smithi197.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2021-07-26T15:33:33.105 INFO:teuthology.orchestra.run.smithi197.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2021-07-26T15:33:33.107 INFO:teuthology.orchestra.run.smithi197.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2 [59.1 kB] 2021-07-26T15:33:33.109 INFO:teuthology.orchestra.run.smithi183.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jwt all 1.7.1-2ubuntu2 [17.4 kB] 2021-07-26T15:33:33.110 INFO:teuthology.orchestra.run.smithi183.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2021-07-26T15:33:33.112 INFO:teuthology.orchestra.run.smithi183.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2021-07-26T15:33:33.113 INFO:teuthology.orchestra.run.smithi183.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2 [59.1 kB] 2021-07-26T15:33:33.170 INFO:teuthology.orchestra.run.smithi183.stdout:Get:17 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 15.2.13-213-g0f589fd5-1focal [463 kB] 2021-07-26T15:33:33.179 INFO:teuthology.orchestra.run.smithi197.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2021-07-26T15:33:33.180 INFO:teuthology.orchestra.run.smithi197.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2021-07-26T15:33:33.182 INFO:teuthology.orchestra.run.smithi197.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2021-07-26T15:33:33.184 INFO:teuthology.orchestra.run.smithi183.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2021-07-26T15:33:33.185 INFO:teuthology.orchestra.run.smithi197.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2021-07-26T15:33:33.186 INFO:teuthology.orchestra.run.smithi183.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2021-07-26T15:33:33.187 INFO:teuthology.orchestra.run.smithi183.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2021-07-26T15:33:33.187 INFO:teuthology.orchestra.run.smithi197.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2021-07-26T15:33:33.189 INFO:teuthology.orchestra.run.smithi183.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2021-07-26T15:33:33.192 INFO:teuthology.orchestra.run.smithi183.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2021-07-26T15:33:33.220 INFO:teuthology.orchestra.run.smithi183.stdout:Get:23 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 15.2.13-213-g0f589fd5-1focal [366 kB] 2021-07-26T15:33:33.238 INFO:teuthology.orchestra.run.smithi183.stdout:Get:24 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 15.2.13-213-g0f589fd5-1focal [20.8 kB] 2021-07-26T15:33:33.238 INFO:teuthology.orchestra.run.smithi183.stdout:Get:25 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 15.2.13-213-g0f589fd5-1focal [156 kB] 2021-07-26T15:33:33.247 INFO:teuthology.orchestra.run.smithi183.stdout:Get:26 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 15.2.13-213-g0f589fd5-1focal [29.0 kB] 2021-07-26T15:33:33.248 INFO:teuthology.orchestra.run.smithi183.stdout:Get:27 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 15.2.13-213-g0f589fd5-1focal [363 kB] 2021-07-26T15:33:33.263 INFO:teuthology.orchestra.run.smithi197.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-waitress all 1.4.1-1 [80.6 kB] 2021-07-26T15:33:33.266 INFO:teuthology.orchestra.run.smithi197.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2021-07-26T15:33:33.266 INFO:teuthology.orchestra.run.smithi183.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-waitress all 1.4.1-1 [80.6 kB] 2021-07-26T15:33:33.267 INFO:teuthology.orchestra.run.smithi197.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2021-07-26T15:33:33.270 INFO:teuthology.orchestra.run.smithi183.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2021-07-26T15:33:33.270 INFO:teuthology.orchestra.run.smithi183.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2021-07-26T15:33:33.284 INFO:teuthology.orchestra.run.smithi197.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2021-07-26T15:33:33.285 INFO:teuthology.orchestra.run.smithi197.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2021-07-26T15:33:33.291 INFO:teuthology.orchestra.run.smithi183.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2021-07-26T15:33:33.291 INFO:teuthology.orchestra.run.smithi183.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2021-07-26T15:33:33.294 INFO:teuthology.orchestra.run.smithi183.stdout:Get:33 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 15.2.13-213-g0f589fd5-1focal [3,140 kB] 2021-07-26T15:33:33.355 INFO:teuthology.orchestra.run.smithi197.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2021-07-26T15:33:33.356 INFO:teuthology.orchestra.run.smithi197.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2021-07-26T15:33:33.359 INFO:teuthology.orchestra.run.smithi183.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2021-07-26T15:33:33.360 INFO:teuthology.orchestra.run.smithi183.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2021-07-26T15:33:33.361 INFO:teuthology.orchestra.run.smithi197.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2021-07-26T15:33:33.363 INFO:teuthology.orchestra.run.smithi183.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2021-07-26T15:33:33.369 INFO:teuthology.orchestra.run.smithi197.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2021-07-26T15:33:33.372 INFO:teuthology.orchestra.run.smithi183.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2021-07-26T15:33:33.373 INFO:teuthology.orchestra.run.smithi197.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2021-07-26T15:33:33.376 INFO:teuthology.orchestra.run.smithi183.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2021-07-26T15:33:33.453 INFO:teuthology.orchestra.run.smithi183.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2021-07-26T15:33:33.453 INFO:teuthology.orchestra.run.smithi183.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2021-07-26T15:33:33.455 INFO:teuthology.orchestra.run.smithi197.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2021-07-26T15:33:33.455 INFO:teuthology.orchestra.run.smithi197.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2021-07-26T15:33:33.456 INFO:teuthology.orchestra.run.smithi197.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2021-07-26T15:33:33.456 INFO:teuthology.orchestra.run.smithi197.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2021-07-26T15:33:33.456 INFO:teuthology.orchestra.run.smithi197.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2021-07-26T15:33:33.460 INFO:teuthology.orchestra.run.smithi183.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2021-07-26T15:33:33.461 INFO:teuthology.orchestra.run.smithi183.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2021-07-26T15:33:33.462 INFO:teuthology.orchestra.run.smithi183.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2021-07-26T15:33:33.523 INFO:teuthology.orchestra.run.smithi197.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2021-07-26T15:33:33.524 INFO:teuthology.orchestra.run.smithi183.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2021-07-26T15:33:33.615 INFO:teuthology.orchestra.run.smithi183.stdout:Get:45 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 15.2.13-213-g0f589fd5-1focal [116 kB] 2021-07-26T15:33:33.622 INFO:teuthology.orchestra.run.smithi183.stdout:Get:46 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 15.2.13-213-g0f589fd5-1focal [360 kB] 2021-07-26T15:33:33.683 INFO:teuthology.orchestra.run.smithi183.stdout:Get:47 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 15.2.13-213-g0f589fd5-1focal [20.0 MB] 2021-07-26T15:33:33.839 INFO:teuthology.orchestra.run.smithi197.stdout:Get:38 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 15.2.13-213-g0f589fd5-1focal [463 kB] 2021-07-26T15:33:33.848 INFO:teuthology.orchestra.run.smithi197.stdout:Get:39 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 15.2.13-213-g0f589fd5-1focal [366 kB] 2021-07-26T15:33:33.850 INFO:teuthology.orchestra.run.smithi197.stdout:Get:40 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 15.2.13-213-g0f589fd5-1focal [20.8 kB] 2021-07-26T15:33:33.858 INFO:teuthology.orchestra.run.smithi197.stdout:Get:41 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 15.2.13-213-g0f589fd5-1focal [156 kB] 2021-07-26T15:33:33.891 INFO:teuthology.orchestra.run.smithi197.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2021-07-26T15:33:33.907 INFO:teuthology.orchestra.run.smithi197.stdout:Get:43 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 15.2.13-213-g0f589fd5-1focal [29.0 kB] 2021-07-26T15:33:33.907 INFO:teuthology.orchestra.run.smithi197.stdout:Get:44 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 15.2.13-213-g0f589fd5-1focal [363 kB] 2021-07-26T15:33:33.908 INFO:teuthology.orchestra.run.smithi183.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2021-07-26T15:33:33.945 INFO:teuthology.orchestra.run.smithi197.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2021-07-26T15:33:33.956 INFO:teuthology.orchestra.run.smithi183.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2021-07-26T15:33:33.957 INFO:teuthology.orchestra.run.smithi197.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2021-07-26T15:33:33.965 INFO:teuthology.orchestra.run.smithi183.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2021-07-26T15:33:33.972 INFO:teuthology.orchestra.run.smithi197.stdout:Get:47 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 15.2.13-213-g0f589fd5-1focal [3,140 kB] 2021-07-26T15:33:34.006 INFO:teuthology.orchestra.run.smithi197.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2021-07-26T15:33:34.007 INFO:teuthology.orchestra.run.smithi197.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2021-07-26T15:33:34.008 INFO:teuthology.orchestra.run.smithi197.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2021-07-26T15:33:34.009 INFO:teuthology.orchestra.run.smithi197.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2021-07-26T15:33:34.009 INFO:teuthology.orchestra.run.smithi197.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2021-07-26T15:33:34.010 INFO:teuthology.orchestra.run.smithi197.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2021-07-26T15:33:34.011 INFO:teuthology.orchestra.run.smithi197.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2021-07-26T15:33:34.013 INFO:teuthology.orchestra.run.smithi183.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2021-07-26T15:33:34.014 INFO:teuthology.orchestra.run.smithi183.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2021-07-26T15:33:34.028 INFO:teuthology.orchestra.run.smithi183.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2021-07-26T15:33:34.029 INFO:teuthology.orchestra.run.smithi183.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2021-07-26T15:33:34.030 INFO:teuthology.orchestra.run.smithi183.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2021-07-26T15:33:34.032 INFO:teuthology.orchestra.run.smithi183.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2021-07-26T15:33:34.032 INFO:teuthology.orchestra.run.smithi183.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2021-07-26T15:33:34.060 INFO:teuthology.orchestra.run.smithi197.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2021-07-26T15:33:34.061 INFO:teuthology.orchestra.run.smithi197.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2021-07-26T15:33:34.070 INFO:teuthology.orchestra.run.smithi183.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2021-07-26T15:33:34.071 INFO:teuthology.orchestra.run.smithi183.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2021-07-26T15:33:34.140 INFO:teuthology.orchestra.run.smithi197.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2021-07-26T15:33:34.146 INFO:teuthology.orchestra.run.smithi197.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2021-07-26T15:33:34.149 INFO:teuthology.orchestra.run.smithi197.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2021-07-26T15:33:34.152 INFO:teuthology.orchestra.run.smithi197.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2021-07-26T15:33:34.155 INFO:teuthology.orchestra.run.smithi197.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2021-07-26T15:33:34.156 INFO:teuthology.orchestra.run.smithi183.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2021-07-26T15:33:34.158 INFO:teuthology.orchestra.run.smithi197.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/main amd64 libxslt1.1 amd64 1.1.34-4 [152 kB] 2021-07-26T15:33:34.159 INFO:teuthology.orchestra.run.smithi197.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2021-07-26T15:33:34.161 INFO:teuthology.orchestra.run.smithi183.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2021-07-26T15:33:34.161 INFO:teuthology.orchestra.run.smithi197.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2021-07-26T15:33:34.164 INFO:teuthology.orchestra.run.smithi183.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2021-07-26T15:33:34.167 INFO:teuthology.orchestra.run.smithi183.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2021-07-26T15:33:34.169 INFO:teuthology.orchestra.run.smithi183.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2021-07-26T15:33:34.172 INFO:teuthology.orchestra.run.smithi183.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 libxslt1.1 amd64 1.1.34-4 [152 kB] 2021-07-26T15:33:34.174 INFO:teuthology.orchestra.run.smithi183.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2021-07-26T15:33:34.176 INFO:teuthology.orchestra.run.smithi183.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2021-07-26T15:33:34.222 INFO:teuthology.orchestra.run.smithi197.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2021-07-26T15:33:34.223 INFO:teuthology.orchestra.run.smithi197.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2021-07-26T15:33:34.237 INFO:teuthology.orchestra.run.smithi183.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2021-07-26T15:33:34.238 INFO:teuthology.orchestra.run.smithi183.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2021-07-26T15:33:34.304 INFO:teuthology.orchestra.run.smithi197.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2021-07-26T15:33:34.305 INFO:teuthology.orchestra.run.smithi197.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2021-07-26T15:33:34.307 INFO:teuthology.orchestra.run.smithi197.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.3 [1,382 kB] 2021-07-26T15:33:34.323 INFO:teuthology.orchestra.run.smithi183.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2021-07-26T15:33:34.324 INFO:teuthology.orchestra.run.smithi183.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2021-07-26T15:33:34.325 INFO:teuthology.orchestra.run.smithi197.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2021-07-26T15:33:34.325 INFO:teuthology.orchestra.run.smithi197.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2021-07-26T15:33:34.326 INFO:teuthology.orchestra.run.smithi183.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.3 [1,382 kB] 2021-07-26T15:33:34.327 INFO:teuthology.orchestra.run.smithi197.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2021-07-26T15:33:34.327 INFO:teuthology.orchestra.run.smithi197.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2021-07-26T15:33:34.327 INFO:teuthology.orchestra.run.smithi197.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-py all 1.8.1-1 [65.4 kB] 2021-07-26T15:33:34.346 INFO:teuthology.orchestra.run.smithi183.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2021-07-26T15:33:34.347 INFO:teuthology.orchestra.run.smithi183.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2021-07-26T15:33:34.347 INFO:teuthology.orchestra.run.smithi183.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2021-07-26T15:33:34.347 INFO:teuthology.orchestra.run.smithi183.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2021-07-26T15:33:34.349 INFO:teuthology.orchestra.run.smithi183.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-py all 1.8.1-1 [65.4 kB] 2021-07-26T15:33:34.386 INFO:teuthology.orchestra.run.smithi197.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2021-07-26T15:33:34.387 INFO:teuthology.orchestra.run.smithi197.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2021-07-26T15:33:34.405 INFO:teuthology.orchestra.run.smithi183.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2021-07-26T15:33:34.406 INFO:teuthology.orchestra.run.smithi183.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2021-07-26T15:33:34.470 INFO:teuthology.orchestra.run.smithi197.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2021-07-26T15:33:34.472 INFO:teuthology.orchestra.run.smithi197.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2021-07-26T15:33:34.490 INFO:teuthology.orchestra.run.smithi183.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2021-07-26T15:33:34.491 INFO:teuthology.orchestra.run.smithi183.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2021-07-26T15:33:34.519 INFO:teuthology.orchestra.run.smithi197.stdout:Get:79 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 15.2.13-213-g0f589fd5-1focal [116 kB] 2021-07-26T15:33:34.521 INFO:teuthology.orchestra.run.smithi197.stdout:Get:80 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 15.2.13-213-g0f589fd5-1focal [360 kB] 2021-07-26T15:33:34.597 INFO:teuthology.orchestra.run.smithi197.stdout:Get:81 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 15.2.13-213-g0f589fd5-1focal [20.0 MB] 2021-07-26T15:33:35.581 INFO:teuthology.orchestra.run.smithi183.stdout:Get:82 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 15.2.13-213-g0f589fd5-1focal [5,301 kB] 2021-07-26T15:33:35.992 INFO:teuthology.orchestra.run.smithi183.stdout:Get:83 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 15.2.13-213-g0f589fd5-1focal [162 kB] 2021-07-26T15:33:36.241 INFO:teuthology.orchestra.run.smithi183.stdout:Get:84 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 15.2.13-213-g0f589fd5-1focal [1,401 kB] 2021-07-26T15:33:36.336 INFO:teuthology.orchestra.run.smithi183.stdout:Get:85 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 15.2.13-213-g0f589fd5-1focal [6,172 kB] 2021-07-26T15:33:36.804 INFO:teuthology.orchestra.run.smithi183.stdout:Get:86 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 15.2.13-213-g0f589fd5-1focal [23.8 MB] 2021-07-26T15:33:38.888 INFO:teuthology.orchestra.run.smithi183.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 15.2.13-213-g0f589fd5-1focal [3,996 B] 2021-07-26T15:33:38.888 INFO:teuthology.orchestra.run.smithi183.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 15.2.13-213-g0f589fd5-1focal [538 kB] 2021-07-26T15:33:38.898 INFO:teuthology.orchestra.run.smithi183.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 15.2.13-213-g0f589fd5-1focal [2,006 kB] 2021-07-26T15:33:39.077 INFO:teuthology.orchestra.run.smithi183.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 15.2.13-213-g0f589fd5-1focal [53.1 kB] 2021-07-26T15:33:39.078 INFO:teuthology.orchestra.run.smithi183.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 15.2.13-213-g0f589fd5-1focal [58.1 kB] 2021-07-26T15:33:39.080 INFO:teuthology.orchestra.run.smithi183.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 15.2.13-213-g0f589fd5-1focal [3,204 kB] 2021-07-26T15:33:39.088 INFO:teuthology.orchestra.run.smithi197.stdout:Get:82 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 15.2.13-213-g0f589fd5-1focal [5,301 kB] 2021-07-26T15:33:42.686 INFO:teuthology.orchestra.run.smithi183.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-cloud all 15.2.13-213-g0f589fd5-1focal [34.3 kB] 2021-07-26T15:33:42.710 INFO:teuthology.orchestra.run.smithi183.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 15.2.13-213-g0f589fd5-1focal [7,891 kB] 2021-07-26T15:33:43.129 INFO:teuthology.orchestra.run.smithi183.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 15.2.13-213-g0f589fd5-1focal [4,108 B] 2021-07-26T15:33:43.133 INFO:teuthology.orchestra.run.smithi183.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 15.2.13-213-g0f589fd5-1focal [39.9 MB] 2021-07-26T15:33:43.300 INFO:teuthology.orchestra.run.smithi197.stdout:Get:83 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 15.2.13-213-g0f589fd5-1focal [162 kB] 2021-07-26T15:33:43.303 INFO:teuthology.orchestra.run.smithi197.stdout:Get:84 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 15.2.13-213-g0f589fd5-1focal [1,401 kB] 2021-07-26T15:33:43.445 INFO:teuthology.orchestra.run.smithi197.stdout:Get:85 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 15.2.13-213-g0f589fd5-1focal [6,172 kB] 2021-07-26T15:33:44.565 INFO:teuthology.orchestra.run.smithi197.stdout:Get:86 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 15.2.13-213-g0f589fd5-1focal [23.8 MB] 2021-07-26T15:33:45.584 INFO:teuthology.orchestra.run.smithi183.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 15.2.13-213-g0f589fd5-1focal [18.1 kB] 2021-07-26T15:33:45.585 INFO:teuthology.orchestra.run.smithi183.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 15.2.13-213-g0f589fd5-1focal [9,717 kB] 2021-07-26T15:33:46.054 INFO:teuthology.orchestra.run.smithi183.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 15.2.13-213-g0f589fd5-1focal [60.9 kB] 2021-07-26T15:33:46.627 INFO:teuthology.orchestra.run.smithi183.stdout:Fetched 153 MB in 14s (11.1 MB/s) 2021-07-26T15:33:46.789 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-07-26T15:33:46.826 INFO:teuthology.orchestra.run.smithi197.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 15.2.13-213-g0f589fd5-1focal [3,996 B] 2021-07-26T15:33:46.827 INFO:teuthology.orchestra.run.smithi197.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 15.2.13-213-g0f589fd5-1focal [538 kB] 2021-07-26T15:33:46.837 INFO:teuthology.orchestra.run.smithi197.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 15.2.13-213-g0f589fd5-1focal [2,006 kB] 2021-07-26T15:33:46.844 INFO:teuthology.orchestra.run.smithi183.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138107 files and directories currently installed.) 2021-07-26T15:33:46.849 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../00-liblttng-ust0_2.11.0-1_amd64.deb ... 2021-07-26T15:33:46.947 INFO:teuthology.orchestra.run.smithi197.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 15.2.13-213-g0f589fd5-1focal [53.1 kB] 2021-07-26T15:33:46.947 INFO:teuthology.orchestra.run.smithi197.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 15.2.13-213-g0f589fd5-1focal [58.1 kB] 2021-07-26T15:33:46.948 INFO:teuthology.orchestra.run.smithi197.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 15.2.13-213-g0f589fd5-1focal [3,204 kB] 2021-07-26T15:33:46.963 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2021-07-26T15:33:47.125 INFO:teuthology.orchestra.run.smithi197.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-cloud all 15.2.13-213-g0f589fd5-1focal [34.3 kB] 2021-07-26T15:33:47.126 INFO:teuthology.orchestra.run.smithi197.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 15.2.13-213-g0f589fd5-1focal [7,891 kB] 2021-07-26T15:33:47.342 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../01-librbd1_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:33:47.442 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking librbd1 (15.2.13-213-g0f589fd5-1focal) over (15.2.13-0ubuntu0.20.04.1) ... 2021-07-26T15:33:47.565 INFO:teuthology.orchestra.run.smithi197.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 15.2.13-213-g0f589fd5-1focal [4,108 B] 2021-07-26T15:33:47.565 INFO:teuthology.orchestra.run.smithi197.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 15.2.13-213-g0f589fd5-1focal [39.9 MB] 2021-07-26T15:33:47.972 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../02-librados2_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:33:48.129 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking librados2 (15.2.13-213-g0f589fd5-1focal) over (15.2.13-0ubuntu0.20.04.1) ... 2021-07-26T15:33:48.792 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package libcephfs2. 2021-07-26T15:33:48.811 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../03-libcephfs2_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:33:48.850 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libcephfs2 (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:33:49.127 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-rados. 2021-07-26T15:33:49.143 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../04-python3-rados_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:33:49.178 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-rados (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:33:49.530 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-07-26T15:33:49.545 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../05-python3-ceph-argparse_15.2.13-213-g0f589fd5-1focal_all.deb ... 2021-07-26T15:33:49.588 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-ceph-argparse (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:33:49.734 INFO:teuthology.orchestra.run.smithi197.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 15.2.13-213-g0f589fd5-1focal [18.1 kB] 2021-07-26T15:33:49.735 INFO:teuthology.orchestra.run.smithi197.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 15.2.13-213-g0f589fd5-1focal [9,717 kB] 2021-07-26T15:33:49.924 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-cephfs. 2021-07-26T15:33:49.941 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../06-python3-cephfs_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:33:49.983 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-cephfs (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:33:50.131 INFO:teuthology.orchestra.run.smithi197.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 15.2.13-213-g0f589fd5-1focal [60.9 kB] 2021-07-26T15:33:50.310 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-ceph-common. 2021-07-26T15:33:50.328 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../07-python3-ceph-common_15.2.13-213-g0f589fd5-1focal_all.deb ... 2021-07-26T15:33:50.368 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-ceph-common (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:33:50.638 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-prettytable. 2021-07-26T15:33:50.655 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../08-python3-prettytable_0.7.2-5_all.deb ... 2021-07-26T15:33:50.688 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2021-07-26T15:33:50.703 INFO:teuthology.orchestra.run.smithi197.stdout:Fetched 153 MB in 18s (8,559 kB/s) 2021-07-26T15:33:50.883 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-07-26T15:33:50.932 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-rbd. 2021-07-26T15:33:50.937 INFO:teuthology.orchestra.run.smithi197.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138107 files and directories currently installed.) 2021-07-26T15:33:50.941 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../00-liblttng-ust0_2.11.0-1_amd64.deb ... 2021-07-26T15:33:50.947 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../09-python3-rbd_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:33:51.023 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2021-07-26T15:33:51.115 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-rbd (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:33:51.359 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../01-librbd1_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:33:51.460 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking librbd1 (15.2.13-213-g0f589fd5-1focal) over (15.2.13-0ubuntu0.20.04.1) ... 2021-07-26T15:33:51.577 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-07-26T15:33:51.593 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../10-librabbitmq4_0.10.0-1_amd64.deb ... 2021-07-26T15:33:51.635 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2021-07-26T15:33:51.965 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-07-26T15:33:51.978 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../11-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2021-07-26T15:33:52.006 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../02-librados2_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:33:52.012 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-07-26T15:33:52.131 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking librados2 (15.2.13-213-g0f589fd5-1focal) over (15.2.13-0ubuntu0.20.04.1) ... 2021-07-26T15:33:52.340 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package librgw2. 2021-07-26T15:33:52.356 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../12-librgw2_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:33:52.407 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking librgw2 (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:33:52.776 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package libcephfs2. 2021-07-26T15:33:52.794 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../03-libcephfs2_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:33:52.827 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking libcephfs2 (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:33:52.985 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-rgw. 2021-07-26T15:33:53.001 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../13-python3-rgw_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:33:53.043 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-rgw (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:33:53.095 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package python3-rados. 2021-07-26T15:33:53.112 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../04-python3-rados_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:33:53.154 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking python3-rados (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:33:53.387 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package libleveldb1d:amd64. 2021-07-26T15:33:53.404 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../14-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2021-07-26T15:33:53.446 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-07-26T15:33:53.515 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-07-26T15:33:53.533 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../05-python3-ceph-argparse_15.2.13-213-g0f589fd5-1focal_all.deb ... 2021-07-26T15:33:53.573 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking python3-ceph-argparse (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:33:53.748 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package liboath0. 2021-07-26T15:33:53.764 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../15-liboath0_2.6.1-1.3_amd64.deb ... 2021-07-26T15:33:53.798 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2021-07-26T15:33:53.877 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package python3-cephfs. 2021-07-26T15:33:53.894 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../06-python3-cephfs_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:33:53.927 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking python3-cephfs (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:33:54.143 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package libradosstriper1. 2021-07-26T15:33:54.160 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../16-libradosstriper1_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:33:54.202 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libradosstriper1 (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:33:54.239 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package python3-ceph-common. 2021-07-26T15:33:54.255 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../07-python3-ceph-common_15.2.13-213-g0f589fd5-1focal_all.deb ... 2021-07-26T15:33:54.297 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking python3-ceph-common (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:33:54.642 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package python3-prettytable. 2021-07-26T15:33:54.658 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../08-python3-prettytable_0.7.2-5_all.deb ... 2021-07-26T15:33:54.693 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package ceph-common. 2021-07-26T15:33:54.699 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2021-07-26T15:33:54.712 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../17-ceph-common_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:33:54.754 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking ceph-common (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:33:54.936 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package python3-rbd. 2021-07-26T15:33:54.951 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../09-python3-rbd_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:33:55.010 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking python3-rbd (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:33:55.372 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-07-26T15:33:55.390 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../10-librabbitmq4_0.10.0-1_amd64.deb ... 2021-07-26T15:33:55.422 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2021-07-26T15:33:55.740 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-07-26T15:33:55.757 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../11-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2021-07-26T15:33:55.800 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-07-26T15:33:56.169 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package librgw2. 2021-07-26T15:33:56.184 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../12-librgw2_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:33:56.227 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking librgw2 (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:33:56.796 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package python3-rgw. 2021-07-26T15:33:56.816 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../13-python3-rgw_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:33:56.852 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking python3-rgw (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:33:56.852 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package ceph-base. 2021-07-26T15:33:56.860 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../18-ceph-base_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:33:56.913 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking ceph-base (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:33:57.141 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package libleveldb1d:amd64. 2021-07-26T15:33:57.156 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../14-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2021-07-26T15:33:57.190 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-07-26T15:33:57.560 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package liboath0. 2021-07-26T15:33:57.576 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../15-liboath0_2.6.1-1.3_amd64.deb ... 2021-07-26T15:33:57.618 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2021-07-26T15:33:57.864 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-cryptography. 2021-07-26T15:33:57.881 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../19-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2021-07-26T15:33:57.938 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package libradosstriper1. 2021-07-26T15:33:57.957 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2021-07-26T15:33:57.958 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../16-libradosstriper1_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:33:57.996 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking libradosstriper1 (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:33:58.391 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package ceph-common. 2021-07-26T15:33:58.407 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../17-ceph-common_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:33:58.440 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking ceph-common (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:33:58.485 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-openssl. 2021-07-26T15:33:58.501 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../20-python3-openssl_19.0.0-1build1_all.deb ... 2021-07-26T15:33:58.543 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2021-07-26T15:33:58.821 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-07-26T15:33:58.837 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../21-ceph-mgr-modules-core_15.2.13-213-g0f589fd5-1focal_all.deb ... 2021-07-26T15:33:58.879 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking ceph-mgr-modules-core (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:33:59.267 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-bcrypt. 2021-07-26T15:33:59.284 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../22-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2021-07-26T15:33:59.350 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2021-07-26T15:33:59.711 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-cherrypy3. 2021-07-26T15:33:59.727 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../23-python3-cherrypy3_8.9.1-6_all.deb ... 2021-07-26T15:33:59.769 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2021-07-26T15:34:00.148 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-jwt. 2021-07-26T15:34:00.165 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../24-python3-jwt_1.7.1-2ubuntu2_all.deb ... 2021-07-26T15:34:00.206 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2) ... 2021-07-26T15:34:00.543 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-logutils. 2021-07-26T15:34:00.562 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../25-python3-logutils_0.3.3-7_all.deb ... 2021-07-26T15:34:00.563 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package ceph-base. 2021-07-26T15:34:00.579 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../18-ceph-base_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:34:00.601 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-logutils (0.3.3-7) ... 2021-07-26T15:34:00.631 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking ceph-base (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:34:00.929 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-markupsafe. 2021-07-26T15:34:00.945 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../26-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2021-07-26T15:34:00.987 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2021-07-26T15:34:01.315 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-mako. 2021-07-26T15:34:01.332 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../27-python3-mako_1.1.0+ds1-1ubuntu2_all.deb ... 2021-07-26T15:34:01.373 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-07-26T15:34:01.525 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package python3-cryptography. 2021-07-26T15:34:01.547 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../19-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2021-07-26T15:34:01.584 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2021-07-26T15:34:01.751 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-simplegeneric. 2021-07-26T15:34:01.768 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../28-python3-simplegeneric_0.8.1-3_all.deb ... 2021-07-26T15:34:01.826 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2021-07-26T15:34:02.147 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-singledispatch. 2021-07-26T15:34:02.167 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../29-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2021-07-26T15:34:02.212 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2021-07-26T15:34:02.548 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-webob. 2021-07-26T15:34:02.564 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../30-python3-webob_1%3a1.8.5-2_all.deb ... 2021-07-26T15:34:02.606 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2021-07-26T15:34:02.655 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package python3-openssl. 2021-07-26T15:34:02.671 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../20-python3-openssl_19.0.0-1build1_all.deb ... 2021-07-26T15:34:02.712 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2021-07-26T15:34:02.961 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-soupsieve. 2021-07-26T15:34:02.976 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../31-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2021-07-26T15:34:02.998 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-07-26T15:34:03.014 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../21-ceph-mgr-modules-core_15.2.13-213-g0f589fd5-1focal_all.deb ... 2021-07-26T15:34:03.018 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2021-07-26T15:34:03.048 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking ceph-mgr-modules-core (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:34:03.362 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-bs4. 2021-07-26T15:34:03.378 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../32-python3-bs4_4.8.2-1_all.deb ... 2021-07-26T15:34:03.429 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2021-07-26T15:34:03.461 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package python3-bcrypt. 2021-07-26T15:34:03.481 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../22-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2021-07-26T15:34:03.519 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2021-07-26T15:34:03.832 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-waitress. 2021-07-26T15:34:03.847 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package python3-cherrypy3. 2021-07-26T15:34:03.848 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../33-python3-waitress_1.4.1-1_all.deb ... 2021-07-26T15:34:03.864 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../23-python3-cherrypy3_8.9.1-6_all.deb ... 2021-07-26T15:34:03.897 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2021-07-26T15:34:03.914 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-waitress (1.4.1-1) ... 2021-07-26T15:34:04.276 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package python3-jwt. 2021-07-26T15:34:04.277 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-tempita. 2021-07-26T15:34:04.292 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../24-python3-jwt_1.7.1-2ubuntu2_all.deb ... 2021-07-26T15:34:04.296 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../34-python3-tempita_0.5.2-6_all.deb ... 2021-07-26T15:34:04.333 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2) ... 2021-07-26T15:34:04.334 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-tempita (0.5.2-6) ... 2021-07-26T15:34:04.662 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package python3-logutils. 2021-07-26T15:34:04.663 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-paste. 2021-07-26T15:34:04.681 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../25-python3-logutils_0.3.3-7_all.deb ... 2021-07-26T15:34:04.682 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../35-python3-paste_3.4.0+dfsg1-1_all.deb ... 2021-07-26T15:34:04.721 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2021-07-26T15:34:04.729 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking python3-logutils (0.3.3-7) ... 2021-07-26T15:34:05.057 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-07-26T15:34:05.073 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package python3-markupsafe. 2021-07-26T15:34:05.075 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../36-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2021-07-26T15:34:05.090 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../26-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2021-07-26T15:34:05.115 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2021-07-26T15:34:05.133 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2021-07-26T15:34:05.459 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package python3-mako. 2021-07-26T15:34:05.460 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-pastedeploy. 2021-07-26T15:34:05.478 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../37-python3-pastedeploy_2.1.0-1_all.deb ... 2021-07-26T15:34:05.479 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../27-python3-mako_1.1.0+ds1-1ubuntu2_all.deb ... 2021-07-26T15:34:05.518 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2021-07-26T15:34:05.519 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-07-26T15:34:05.821 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package python3-simplegeneric. 2021-07-26T15:34:05.836 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../28-python3-simplegeneric_0.8.1-3_all.deb ... 2021-07-26T15:34:05.876 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-webtest. 2021-07-26T15:34:05.877 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2021-07-26T15:34:05.891 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../38-python3-webtest_2.0.32-2_all.deb ... 2021-07-26T15:34:05.930 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-webtest (2.0.32-2) ... 2021-07-26T15:34:06.132 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package python3-singledispatch. 2021-07-26T15:34:06.152 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../29-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2021-07-26T15:34:06.181 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2021-07-26T15:34:06.270 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-pecan. 2021-07-26T15:34:06.285 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../39-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2021-07-26T15:34:06.327 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2021-07-26T15:34:06.500 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package python3-webob. 2021-07-26T15:34:06.516 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../30-python3-webob_1%3a1.8.5-2_all.deb ... 2021-07-26T15:34:06.559 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2021-07-26T15:34:06.951 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package python3-soupsieve. 2021-07-26T15:34:06.963 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../31-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2021-07-26T15:34:07.010 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2021-07-26T15:34:07.254 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-werkzeug. 2021-07-26T15:34:07.272 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../40-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2021-07-26T15:34:07.312 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2021-07-26T15:34:07.332 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package python3-bs4. 2021-07-26T15:34:07.347 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../32-python3-bs4_4.8.2-1_all.deb ... 2021-07-26T15:34:07.389 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2021-07-26T15:34:07.640 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package ceph-mgr. 2021-07-26T15:34:07.656 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../41-ceph-mgr_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:34:07.690 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking ceph-mgr (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:34:07.718 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package python3-waitress. 2021-07-26T15:34:07.741 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../33-python3-waitress_1.4.1-1_all.deb ... 2021-07-26T15:34:07.774 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking python3-waitress (1.4.1-1) ... 2021-07-26T15:34:08.212 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package ceph-mon. 2021-07-26T15:34:08.230 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../42-ceph-mon_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:34:08.268 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking ceph-mon (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:34:08.271 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package python3-tempita. 2021-07-26T15:34:08.287 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../34-python3-tempita_0.5.2-6_all.deb ... 2021-07-26T15:34:08.354 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking python3-tempita (0.5.2-6) ... 2021-07-26T15:34:08.724 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package python3-paste. 2021-07-26T15:34:08.742 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../35-python3-paste_3.4.0+dfsg1-1_all.deb ... 2021-07-26T15:34:08.815 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2021-07-26T15:34:09.119 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-07-26T15:34:09.135 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../36-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2021-07-26T15:34:09.210 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2021-07-26T15:34:09.422 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package ceph-osd. 2021-07-26T15:34:09.439 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../43-ceph-osd_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:34:09.480 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking ceph-osd (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:34:09.521 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package python3-pastedeploy. 2021-07-26T15:34:09.538 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../37-python3-pastedeploy_2.1.0-1_all.deb ... 2021-07-26T15:34:09.590 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2021-07-26T15:34:09.891 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package python3-webtest. 2021-07-26T15:34:09.906 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../38-python3-webtest_2.0.32-2_all.deb ... 2021-07-26T15:34:09.974 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking python3-webtest (2.0.32-2) ... 2021-07-26T15:34:10.277 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package python3-pecan. 2021-07-26T15:34:10.294 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../39-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2021-07-26T15:34:10.360 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2021-07-26T15:34:10.732 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package python3-werkzeug. 2021-07-26T15:34:10.749 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../40-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2021-07-26T15:34:10.790 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2021-07-26T15:34:11.152 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package ceph-mgr. 2021-07-26T15:34:11.173 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../41-ceph-mgr_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:34:11.211 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking ceph-mgr (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:34:11.713 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package ceph-mon. 2021-07-26T15:34:11.731 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../42-ceph-mon_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:34:11.771 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking ceph-mon (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:34:11.810 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package ceph. 2021-07-26T15:34:11.830 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../44-ceph_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:34:11.868 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking ceph (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:34:12.213 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package ceph-fuse. 2021-07-26T15:34:12.229 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../45-ceph-fuse_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:34:12.271 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking ceph-fuse (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:34:12.691 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package ceph-mds. 2021-07-26T15:34:12.707 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../46-ceph-mds_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:34:12.749 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking ceph-mds (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:34:12.833 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package ceph-osd. 2021-07-26T15:34:12.850 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../43-ceph-osd_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:34:12.891 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking ceph-osd (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:34:13.252 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package cephadm. 2021-07-26T15:34:13.270 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../47-cephadm_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:34:13.310 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking cephadm (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:34:13.672 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-jinja2. 2021-07-26T15:34:13.692 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../48-python3-jinja2_2.10.1-2_all.deb ... 2021-07-26T15:34:13.730 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2021-07-26T15:34:14.100 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-07-26T15:34:14.116 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../49-ceph-mgr-cephadm_15.2.13-213-g0f589fd5-1focal_all.deb ... 2021-07-26T15:34:14.158 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking ceph-mgr-cephadm (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:34:14.503 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-repoze.lru. 2021-07-26T15:34:14.518 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../50-python3-repoze.lru_0.7-2_all.deb ... 2021-07-26T15:34:14.594 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2021-07-26T15:34:14.849 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package libjs-underscore. 2021-07-26T15:34:14.862 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../51-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2021-07-26T15:34:14.930 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-07-26T15:34:15.210 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package libjs-sphinxdoc. 2021-07-26T15:34:15.226 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../52-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2021-07-26T15:34:15.291 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-07-26T15:34:15.305 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package ceph. 2021-07-26T15:34:15.322 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../44-ceph_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:34:15.380 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking ceph (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:34:15.661 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-routes. 2021-07-26T15:34:15.677 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../53-python3-routes_2.4.1-2_all.deb ... 2021-07-26T15:34:15.682 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package ceph-fuse. 2021-07-26T15:34:15.702 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../45-ceph-fuse_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:34:15.718 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-routes (2.4.1-2) ... 2021-07-26T15:34:15.757 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking ceph-fuse (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:34:16.080 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-07-26T15:34:16.098 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../54-ceph-mgr-dashboard_15.2.13-213-g0f589fd5-1focal_all.deb ... 2021-07-26T15:34:16.147 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking ceph-mgr-dashboard (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:34:16.177 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package ceph-mds. 2021-07-26T15:34:16.194 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../46-ceph-mds_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:34:16.235 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking ceph-mds (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:34:16.773 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package cephadm. 2021-07-26T15:34:16.792 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../47-cephadm_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:34:16.830 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking cephadm (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:34:17.175 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package python3-jinja2. 2021-07-26T15:34:17.191 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../48-python3-jinja2_2.10.1-2_all.deb ... 2021-07-26T15:34:17.229 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2021-07-26T15:34:17.233 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2021-07-26T15:34:17.245 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../55-ceph-mgr-diskprediction-cloud_15.2.13-213-g0f589fd5-1focal_all.deb ... 2021-07-26T15:34:17.287 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:34:17.577 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-07-26T15:34:17.593 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../49-ceph-mgr-cephadm_15.2.13-213-g0f589fd5-1focal_all.deb ... 2021-07-26T15:34:17.644 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking ceph-mgr-cephadm (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:34:17.690 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-decorator. 2021-07-26T15:34:17.707 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../56-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2021-07-26T15:34:17.772 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2021-07-26T15:34:17.997 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package python3-repoze.lru. 2021-07-26T15:34:18.014 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../50-python3-repoze.lru_0.7-2_all.deb ... 2021-07-26T15:34:18.080 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2021-07-26T15:34:18.093 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2021-07-26T15:34:18.109 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../57-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2021-07-26T15:34:18.160 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-07-26T15:34:18.326 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package libjs-underscore. 2021-07-26T15:34:18.341 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../51-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2021-07-26T15:34:18.383 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-07-26T15:34:18.504 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-scipy. 2021-07-26T15:34:18.520 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../58-python3-scipy_1.3.3-3build1_amd64.deb ... 2021-07-26T15:34:18.563 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2021-07-26T15:34:18.678 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package libjs-sphinxdoc. 2021-07-26T15:34:18.694 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../52-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2021-07-26T15:34:18.744 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-07-26T15:34:19.092 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package python3-routes. 2021-07-26T15:34:19.106 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../53-python3-routes_2.4.1-2_all.deb ... 2021-07-26T15:34:19.147 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking python3-routes (2.4.1-2) ... 2021-07-26T15:34:19.517 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-07-26T15:34:19.532 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../54-ceph-mgr-dashboard_15.2.13-213-g0f589fd5-1focal_all.deb ... 2021-07-26T15:34:19.575 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking ceph-mgr-dashboard (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:34:19.906 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-07-26T15:34:19.924 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../59-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2021-07-26T15:34:19.964 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-07-26T15:34:20.551 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-joblib. 2021-07-26T15:34:20.568 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../60-python3-joblib_0.14.0-3_all.deb ... 2021-07-26T15:34:20.626 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-joblib (0.14.0-3) ... 2021-07-26T15:34:20.632 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2021-07-26T15:34:20.651 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../55-ceph-mgr-diskprediction-cloud_15.2.13-213-g0f589fd5-1focal_all.deb ... 2021-07-26T15:34:20.691 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:34:20.971 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-sklearn. 2021-07-26T15:34:20.991 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../61-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2021-07-26T15:34:21.035 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package python3-decorator. 2021-07-26T15:34:21.037 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-07-26T15:34:21.051 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../56-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2021-07-26T15:34:21.093 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2021-07-26T15:34:21.455 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2021-07-26T15:34:21.471 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../57-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2021-07-26T15:34:21.555 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-07-26T15:34:21.813 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-07-26T15:34:21.829 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../62-ceph-mgr-diskprediction-local_15.2.13-213-g0f589fd5-1focal_all.deb ... 2021-07-26T15:34:21.871 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking ceph-mgr-diskprediction-local (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:34:21.883 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package python3-scipy. 2021-07-26T15:34:21.899 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../58-python3-scipy_1.3.3-3build1_amd64.deb ... 2021-07-26T15:34:21.957 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2021-07-26T15:34:23.335 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-07-26T15:34:23.353 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../59-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2021-07-26T15:34:23.357 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-cachetools. 2021-07-26T15:34:23.375 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../63-python3-cachetools_4.0.0-1_all.deb ... 2021-07-26T15:34:23.392 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-07-26T15:34:23.440 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2021-07-26T15:34:23.727 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-pyasn1. 2021-07-26T15:34:23.746 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../64-python3-pyasn1_0.4.2-3build1_all.deb ... 2021-07-26T15:34:23.811 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2021-07-26T15:34:23.988 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package python3-joblib. 2021-07-26T15:34:24.004 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../60-python3-joblib_0.14.0-3_all.deb ... 2021-07-26T15:34:24.046 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking python3-joblib (0.14.0-3) ... 2021-07-26T15:34:24.180 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-07-26T15:34:24.188 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../65-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2021-07-26T15:34:24.231 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-07-26T15:34:24.486 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package python3-sklearn. 2021-07-26T15:34:24.499 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../61-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2021-07-26T15:34:24.541 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-07-26T15:34:24.575 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-rsa. 2021-07-26T15:34:24.592 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../66-python3-rsa_4.0-3_all.deb ... 2021-07-26T15:34:24.632 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-rsa (4.0-3) ... 2021-07-26T15:34:24.969 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-google-auth. 2021-07-26T15:34:24.990 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../67-python3-google-auth_1.5.1-2_all.deb ... 2021-07-26T15:34:25.027 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2021-07-26T15:34:25.325 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-07-26T15:34:25.345 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../62-ceph-mgr-diskprediction-local_15.2.13-213-g0f589fd5-1focal_all.deb ... 2021-07-26T15:34:25.372 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-blinker. 2021-07-26T15:34:25.388 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../68-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2021-07-26T15:34:25.408 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking ceph-mgr-diskprediction-local (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:34:25.430 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-07-26T15:34:25.767 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-oauthlib. 2021-07-26T15:34:25.784 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../69-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2021-07-26T15:34:25.825 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2021-07-26T15:34:26.171 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-requests-oauthlib. 2021-07-26T15:34:26.192 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../70-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2021-07-26T15:34:26.247 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-07-26T15:34:26.528 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package python3-cachetools. 2021-07-26T15:34:26.546 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../63-python3-cachetools_4.0.0-1_all.deb ... 2021-07-26T15:34:26.585 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2021-07-26T15:34:26.607 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-websocket. 2021-07-26T15:34:26.626 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../71-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2021-07-26T15:34:26.665 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2021-07-26T15:34:26.922 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package python3-pyasn1. 2021-07-26T15:34:26.939 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../64-python3-pyasn1_0.4.2-3build1_all.deb ... 2021-07-26T15:34:26.980 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2021-07-26T15:34:27.011 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-kubernetes. 2021-07-26T15:34:27.026 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../72-python3-kubernetes_7.0.0~a1-2_all.deb ... 2021-07-26T15:34:27.068 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2021-07-26T15:34:27.359 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-07-26T15:34:27.377 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../65-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2021-07-26T15:34:27.451 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-07-26T15:34:27.639 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-07-26T15:34:27.659 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../73-ceph-mgr-k8sevents_15.2.13-213-g0f589fd5-1focal_all.deb ... 2021-07-26T15:34:27.722 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking ceph-mgr-k8sevents (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:34:27.761 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package python3-rsa. 2021-07-26T15:34:27.777 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../66-python3-rsa_4.0-3_all.deb ... 2021-07-26T15:34:27.845 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking python3-rsa (4.0-3) ... 2021-07-26T15:34:28.067 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package libonig5:amd64. 2021-07-26T15:34:28.084 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../74-libonig5_6.9.4-1_amd64.deb ... 2021-07-26T15:34:28.125 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2021-07-26T15:34:28.182 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package python3-google-auth. 2021-07-26T15:34:28.201 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../67-python3-google-auth_1.5.1-2_all.deb ... 2021-07-26T15:34:28.248 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2021-07-26T15:34:28.503 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package libjq1:amd64. 2021-07-26T15:34:28.520 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../75-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-07-26T15:34:28.561 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-07-26T15:34:28.601 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package python3-blinker. 2021-07-26T15:34:28.618 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../68-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2021-07-26T15:34:28.659 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-07-26T15:34:28.864 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package jq. 2021-07-26T15:34:28.881 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../76-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-07-26T15:34:28.922 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2021-07-26T15:34:28.988 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package python3-oauthlib. 2021-07-26T15:34:29.004 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../69-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2021-07-26T15:34:29.046 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2021-07-26T15:34:29.208 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package socat. 2021-07-26T15:34:29.224 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../77-socat_1.7.3.3-2_amd64.deb ... 2021-07-26T15:34:29.266 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking socat (1.7.3.3-2) ... 2021-07-26T15:34:29.390 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package python3-requests-oauthlib. 2021-07-26T15:34:29.409 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../70-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2021-07-26T15:34:29.448 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-07-26T15:34:29.678 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-07-26T15:34:29.695 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../78-libxslt1.1_1.1.34-4_amd64.deb ... 2021-07-26T15:34:29.736 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libxslt1.1:amd64 (1.1.34-4) ... 2021-07-26T15:34:29.784 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package python3-websocket. 2021-07-26T15:34:29.802 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../71-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2021-07-26T15:34:29.842 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2021-07-26T15:34:30.039 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package xmlstarlet. 2021-07-26T15:34:30.056 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../79-xmlstarlet_1.6.1-2build1_amd64.deb ... 2021-07-26T15:34:30.097 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2021-07-26T15:34:30.213 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package python3-kubernetes. 2021-07-26T15:34:30.230 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../72-python3-kubernetes_7.0.0~a1-2_all.deb ... 2021-07-26T15:34:30.271 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2021-07-26T15:34:30.468 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package ceph-test. 2021-07-26T15:34:30.486 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../80-ceph-test_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:34:30.542 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking ceph-test (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:34:30.809 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-07-26T15:34:30.826 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../73-ceph-mgr-k8sevents_15.2.13-213-g0f589fd5-1focal_all.deb ... 2021-07-26T15:34:30.909 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking ceph-mgr-k8sevents (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:34:31.278 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package libonig5:amd64. 2021-07-26T15:34:31.295 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../74-libonig5_6.9.4-1_amd64.deb ... 2021-07-26T15:34:31.337 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2021-07-26T15:34:31.740 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package libjq1:amd64. 2021-07-26T15:34:31.755 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../75-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-07-26T15:34:31.798 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-07-26T15:34:32.067 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package jq. 2021-07-26T15:34:32.085 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../76-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-07-26T15:34:32.125 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2021-07-26T15:34:32.378 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package socat. 2021-07-26T15:34:32.395 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../77-socat_1.7.3.3-2_amd64.deb ... 2021-07-26T15:34:32.445 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking socat (1.7.3.3-2) ... 2021-07-26T15:34:32.865 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-07-26T15:34:32.881 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../78-libxslt1.1_1.1.34-4_amd64.deb ... 2021-07-26T15:34:32.923 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking libxslt1.1:amd64 (1.1.34-4) ... 2021-07-26T15:34:33.226 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package xmlstarlet. 2021-07-26T15:34:33.243 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../79-xmlstarlet_1.6.1-2build1_amd64.deb ... 2021-07-26T15:34:33.286 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2021-07-26T15:34:33.657 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package ceph-test. 2021-07-26T15:34:33.676 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../80-ceph-test_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:34:33.715 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking ceph-test (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:34:34.090 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package libcephfs-dev. 2021-07-26T15:34:34.110 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../81-libcephfs-dev_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:34:34.148 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libcephfs-dev (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:34:34.543 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package nvme-cli. 2021-07-26T15:34:34.562 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../82-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2021-07-26T15:34:34.618 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2021-07-26T15:34:34.966 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-atomicwrites. 2021-07-26T15:34:34.983 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../83-python3-atomicwrites_1.1.5-2build1_all.deb ... 2021-07-26T15:34:35.015 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2021-07-26T15:34:35.309 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-attr. 2021-07-26T15:34:35.328 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../84-python3-attr_19.3.0-2_all.deb ... 2021-07-26T15:34:35.367 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-attr (19.3.0-2) ... 2021-07-26T15:34:35.711 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-webencodings. 2021-07-26T15:34:35.728 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../85-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2021-07-26T15:34:35.769 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2021-07-26T15:34:36.097 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-html5lib. 2021-07-26T15:34:36.122 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../86-python3-html5lib_1.0.1-2_all.deb ... 2021-07-26T15:34:36.181 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2021-07-26T15:34:36.558 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-07-26T15:34:36.575 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../87-python3-lxml_4.5.0-1ubuntu0.3_amd64.deb ... 2021-07-26T15:34:36.616 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-07-26T15:34:37.070 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-packaging. 2021-07-26T15:34:37.090 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../88-python3-packaging_20.3-1_all.deb ... 2021-07-26T15:34:37.128 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-packaging (20.3-1) ... 2021-07-26T15:34:37.172 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package libcephfs-dev. 2021-07-26T15:34:37.190 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../81-libcephfs-dev_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:34:37.229 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking libcephfs-dev (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:34:37.459 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-pastescript. 2021-07-26T15:34:37.475 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../89-python3-pastescript_2.0.2-4_all.deb ... 2021-07-26T15:34:37.514 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2021-07-26T15:34:37.675 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package nvme-cli. 2021-07-26T15:34:37.691 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../82-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2021-07-26T15:34:37.751 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2021-07-26T15:34:37.850 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-pluggy. 2021-07-26T15:34:37.868 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../90-python3-pluggy_0.13.0-2_all.deb ... 2021-07-26T15:34:37.930 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2021-07-26T15:34:38.148 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package python3-atomicwrites. 2021-07-26T15:34:38.165 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../83-python3-atomicwrites_1.1.5-2build1_all.deb ... 2021-07-26T15:34:38.238 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2021-07-26T15:34:38.239 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-psutil. 2021-07-26T15:34:38.262 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../91-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2021-07-26T15:34:38.313 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2021-07-26T15:34:38.617 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package python3-attr. 2021-07-26T15:34:38.636 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../84-python3-attr_19.3.0-2_all.deb ... 2021-07-26T15:34:38.666 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-py. 2021-07-26T15:34:38.683 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../92-python3-py_1.8.1-1_all.deb ... 2021-07-26T15:34:38.725 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-py (1.8.1-1) ... 2021-07-26T15:34:39.078 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-pyinotify. 2021-07-26T15:34:39.095 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../93-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2021-07-26T15:34:39.136 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-07-26T15:34:39.158 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking python3-attr (19.3.0-2) ... 2021-07-26T15:34:39.481 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-wcwidth. 2021-07-26T15:34:39.499 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../94-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2021-07-26T15:34:39.536 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package python3-webencodings. 2021-07-26T15:34:39.539 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2021-07-26T15:34:39.554 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../85-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2021-07-26T15:34:39.595 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2021-07-26T15:34:39.899 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-pytest. 2021-07-26T15:34:39.906 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package python3-html5lib. 2021-07-26T15:34:39.918 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../95-python3-pytest_4.6.9-1_all.deb ... 2021-07-26T15:34:39.925 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../86-python3-html5lib_1.0.1-2_all.deb ... 2021-07-26T15:34:39.957 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-pytest (4.6.9-1) ... 2021-07-26T15:34:39.972 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2021-07-26T15:34:40.338 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-simplejson. 2021-07-26T15:34:40.354 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../96-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2021-07-26T15:34:40.359 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-07-26T15:34:40.378 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../87-python3-lxml_4.5.0-1ubuntu0.3_amd64.deb ... 2021-07-26T15:34:40.417 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-07-26T15:34:40.430 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2021-07-26T15:34:40.879 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package python3-packaging. 2021-07-26T15:34:40.895 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../88-python3-packaging_20.3-1_all.deb ... 2021-07-26T15:34:40.899 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package radosgw. 2021-07-26T15:34:40.916 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../97-radosgw_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:34:40.929 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking python3-packaging (20.3-1) ... 2021-07-26T15:34:40.958 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking radosgw (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:34:41.240 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package python3-pastescript. 2021-07-26T15:34:41.260 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../89-python3-pastescript_2.0.2-4_all.deb ... 2021-07-26T15:34:41.298 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2021-07-26T15:34:41.646 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package python3-pluggy. 2021-07-26T15:34:41.662 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../90-python3-pluggy_0.13.0-2_all.deb ... 2021-07-26T15:34:41.704 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2021-07-26T15:34:42.000 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package python3-psutil. 2021-07-26T15:34:42.018 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../91-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2021-07-26T15:34:42.036 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package rbd-fuse. 2021-07-26T15:34:42.054 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../98-rbd-fuse_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:34:42.057 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2021-07-26T15:34:42.094 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking rbd-fuse (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:34:42.394 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package python3-py. 2021-07-26T15:34:42.410 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../92-python3-py_1.8.1-1_all.deb ... 2021-07-26T15:34:42.419 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-attr (19.3.0-2) ... 2021-07-26T15:34:42.444 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking python3-py (1.8.1-1) ... 2021-07-26T15:34:42.750 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-07-26T15:34:42.786 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package python3-pyinotify. 2021-07-26T15:34:42.803 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../93-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2021-07-26T15:34:42.844 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-07-26T15:34:42.902 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2021-07-26T15:34:43.027 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2021-07-26T15:34:43.156 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package python3-wcwidth. 2021-07-26T15:34:43.176 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../94-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2021-07-26T15:34:43.215 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2021-07-26T15:34:43.254 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up cephadm (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:34:43.541 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package python3-pytest. 2021-07-26T15:34:43.561 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../95-python3-pytest_4.6.9-1_all.deb ... 2021-07-26T15:34:43.599 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking python3-pytest (4.6.9-1) ... 2021-07-26T15:34:43.799 INFO:teuthology.orchestra.run.smithi183.stdout:Adding system user cephadm....done 2021-07-26T15:34:43.985 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-waitress (1.4.1-1) ... 2021-07-26T15:34:43.995 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package python3-simplejson. 2021-07-26T15:34:44.011 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../96-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2021-07-26T15:34:44.054 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2021-07-26T15:34:44.337 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-repoze.lru (0.7-2) ... 2021-07-26T15:34:44.549 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package radosgw. 2021-07-26T15:34:44.566 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../97-radosgw_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:34:44.615 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking radosgw (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:34:44.655 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up liboath0 (2.6.1-1.3) ... 2021-07-26T15:34:44.782 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-py (1.8.1-1) ... 2021-07-26T15:34:45.108 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-joblib (0.14.0-3) ... 2021-07-26T15:34:45.518 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-jwt (1.7.1-2ubuntu2) ... 2021-07-26T15:34:45.701 INFO:teuthology.orchestra.run.smithi197.stdout:Selecting previously unselected package rbd-fuse. 2021-07-26T15:34:45.720 INFO:teuthology.orchestra.run.smithi197.stdout:Preparing to unpack .../98-rbd-fuse_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:34:45.760 INFO:teuthology.orchestra.run.smithi197.stdout:Unpacking rbd-fuse (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:34:45.820 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-cachetools (4.0.0-1) ... 2021-07-26T15:34:46.077 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up python3-attr (19.3.0-2) ... 2021-07-26T15:34:46.121 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2021-07-26T15:34:46.402 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-07-26T15:34:46.405 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-07-26T15:34:46.544 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2021-07-26T15:34:46.670 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2021-07-26T15:34:46.756 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-ceph-argparse (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:34:46.905 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up cephadm (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:34:47.040 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-07-26T15:34:47.200 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2021-07-26T15:34:47.493 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2021-07-26T15:34:47.500 INFO:teuthology.orchestra.run.smithi197.stdout:Adding system user cephadm....done 2021-07-26T15:34:47.688 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up python3-waitress (1.4.1-1) ... 2021-07-26T15:34:47.828 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2021-07-26T15:34:48.048 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up python3-repoze.lru (0.7-2) ... 2021-07-26T15:34:48.196 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2021-07-26T15:34:48.341 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up liboath0 (2.6.1-1.3) ... 2021-07-26T15:34:48.455 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2021-07-26T15:34:48.475 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up python3-py (1.8.1-1) ... 2021-07-26T15:34:48.802 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up python3-joblib (0.14.0-3) ... 2021-07-26T15:34:48.857 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2021-07-26T15:34:49.149 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2021-07-26T15:34:49.237 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up python3-jwt (1.7.1-2ubuntu2) ... 2021-07-26T15:34:49.509 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-tempita (0.5.2-6) ... 2021-07-26T15:34:49.530 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up python3-cachetools (4.0.0-1) ... 2021-07-26T15:34:49.815 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2021-07-26T15:34:49.835 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-packaging (20.3-1) ... 2021-07-26T15:34:50.124 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-07-26T15:34:50.147 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2021-07-26T15:34:50.282 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2021-07-26T15:34:50.451 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up python3-ceph-argparse (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:34:50.566 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2021-07-26T15:34:50.736 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-07-26T15:34:50.837 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2021-07-26T15:34:50.993 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2021-07-26T15:34:51.096 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2021-07-26T15:34:51.369 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2021-07-26T15:34:51.406 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2021-07-26T15:34:51.721 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up socat (1.7.3.3-2) ... 2021-07-26T15:34:51.808 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2021-07-26T15:34:51.822 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-ceph-common (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:34:52.092 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2021-07-26T15:34:52.115 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-html5lib (1.0.1-2) ... 2021-07-26T15:34:52.460 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2021-07-26T15:34:52.466 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-07-26T15:34:52.592 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-pluggy (0.13.0-2) ... 2021-07-26T15:34:52.771 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2021-07-26T15:34:52.893 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libxslt1.1:amd64 (1.1.34-4) ... 2021-07-26T15:34:53.028 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2021-07-26T15:34:53.107 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up python3-tempita (0.5.2-6) ... 2021-07-26T15:34:53.363 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2021-07-26T15:34:53.375 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up python3-packaging (20.3-1) ... 2021-07-26T15:34:53.701 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2021-07-26T15:34:53.802 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2021-07-26T15:34:53.897 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-logutils (0.3.3-7) ... 2021-07-26T15:34:54.095 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2021-07-26T15:34:54.173 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2021-07-26T15:34:54.299 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2021-07-26T15:34:54.489 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2021-07-26T15:34:54.592 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-prettytable (0.7.2-5) ... 2021-07-26T15:34:54.873 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2021-07-26T15:34:54.893 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2021-07-26T15:34:55.219 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2021-07-26T15:34:55.259 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up socat (1.7.3.3-2) ... 2021-07-26T15:34:55.377 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up python3-ceph-common (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:34:55.582 INFO:teuthology.orchestra.run.smithi183.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-07-26T15:34:55.653 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up python3-html5lib (1.0.1-2) ... 2021-07-26T15:34:55.838 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2021-07-26T15:34:55.962 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-07-26T15:34:55.972 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-07-26T15:34:56.114 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up python3-pluggy (0.13.0-2) ... 2021-07-26T15:34:56.299 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2021-07-26T15:34:56.415 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up libxslt1.1:amd64 (1.1.34-4) ... 2021-07-26T15:34:56.541 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2021-07-26T15:34:56.669 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-07-26T15:34:56.792 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-07-26T15:34:56.885 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2021-07-26T15:34:56.952 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-webob (1:1.8.5-2) ... 2021-07-26T15:34:57.178 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up python3-logutils (0.3.3-7) ... 2021-07-26T15:34:57.304 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-07-26T15:34:57.454 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2021-07-26T15:34:57.572 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up librados2 (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:34:57.588 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2021-07-26T15:34:57.714 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2021-07-26T15:34:57.873 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up python3-prettytable (0.7.2-5) ... 2021-07-26T15:34:58.198 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2021-07-26T15:34:58.550 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2021-07-26T15:34:58.912 INFO:teuthology.orchestra.run.smithi197.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-07-26T15:34:59.169 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2021-07-26T15:34:59.180 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up librgw2 (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:34:59.270 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-07-26T15:34:59.289 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-07-26T15:34:59.444 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-pytest (4.6.9-1) ... 2021-07-26T15:34:59.588 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2021-07-26T15:34:59.823 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2021-07-26T15:34:59.949 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-07-26T15:35:00.083 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-07-26T15:35:00.141 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2021-07-26T15:35:00.251 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up python3-webob (1:1.8.5-2) ... 2021-07-26T15:35:00.482 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-bs4 (4.8.2-1) ... 2021-07-26T15:35:00.599 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-07-26T15:35:00.833 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libcephfs2 (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:35:00.879 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up librados2 (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:35:00.959 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2021-07-26T15:35:01.004 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2021-07-26T15:35:01.319 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libradosstriper1 (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:35:01.420 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-07-26T15:35:01.747 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-07-26T15:35:02.480 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up librgw2 (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:35:02.603 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-07-26T15:35:02.705 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up python3-pytest (4.6.9-1) ... 2021-07-26T15:35:02.785 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up librbd1 (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:35:02.936 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-07-26T15:35:03.037 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2021-07-26T15:35:03.071 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2021-07-26T15:35:03.138 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-07-26T15:35:03.364 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2021-07-26T15:35:03.448 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2021-07-26T15:35:03.574 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-rsa (4.0-3) ... 2021-07-26T15:35:03.691 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up python3-bs4 (4.8.2-1) ... 2021-07-26T15:35:03.892 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-webtest (2.0.32-2) ... 2021-07-26T15:35:04.054 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up libcephfs2 (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:35:04.193 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2021-07-26T15:35:04.209 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up ceph-mgr-modules-core (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:35:04.360 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up ceph-fuse (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:35:04.503 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up libradosstriper1 (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:35:04.579 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-07-26T15:35:04.580 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-07-26T15:35:04.604 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-07-26T15:35:04.931 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-07-26T15:35:05.062 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libcephfs-dev (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:35:05.171 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-07-26T15:35:05.439 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-pastescript (2.0.2-4) ... 2021-07-26T15:35:05.774 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2021-07-26T15:35:05.980 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up librbd1 (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:35:06.106 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-07-26T15:35:06.142 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-rados (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:35:06.232 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2021-07-26T15:35:06.268 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-rbd (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:35:06.391 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-07-26T15:35:06.394 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up rbd-fuse (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:35:06.537 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-routes (2.4.1-2) ... 2021-07-26T15:35:06.740 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2021-07-26T15:35:06.843 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-google-auth (1.5.1-2) ... 2021-07-26T15:35:06.868 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up python3-rsa (4.0-3) ... 2021-07-26T15:35:07.140 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-rgw (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:35:07.178 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up python3-webtest (2.0.32-2) ... 2021-07-26T15:35:07.266 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-cephfs (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:35:07.454 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up ceph-mgr-modules-core (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:35:07.588 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up ceph-fuse (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:35:07.636 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2021-07-26T15:35:07.811 INFO:teuthology.orchestra.run.smithi197.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-07-26T15:35:07.811 INFO:teuthology.orchestra.run.smithi197.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-07-26T15:35:08.307 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up libcephfs-dev (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:35:08.432 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-07-26T15:35:08.549 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up ceph-common (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:35:08.734 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up python3-pastescript (2.0.2-4) ... 2021-07-26T15:35:09.085 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2021-07-26T15:35:09.094 INFO:teuthology.orchestra.run.smithi183.stdout:Adding group ceph....done 2021-07-26T15:35:09.481 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up python3-rados (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:35:09.504 INFO:teuthology.orchestra.run.smithi183.stdout:Adding system user ceph....done 2021-07-26T15:35:09.630 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up python3-rbd (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:35:09.697 INFO:teuthology.orchestra.run.smithi183.stdout:Setting system user ceph properties....done 2021-07-26T15:35:09.719 INFO:teuthology.orchestra.run.smithi183.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2021-07-26T15:35:09.756 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up rbd-fuse (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:35:09.868 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-07-26T15:35:09.916 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up python3-routes (2.4.1-2) ... 2021-07-26T15:35:10.177 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-07-26T15:35:10.501 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up python3-google-auth (1.5.1-2) ... 2021-07-26T15:35:10.635 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up ceph-test (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:35:10.769 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up radosgw (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:35:10.811 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up python3-rgw (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:35:10.954 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up python3-cephfs (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:35:11.040 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-07-26T15:35:11.040 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-07-26T15:35:11.407 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2021-07-26T15:35:11.665 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up ceph-base (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:35:12.029 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-07-26T15:35:12.329 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up ceph-common (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:35:12.481 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up ceph-mds (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:35:12.719 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-07-26T15:35:12.719 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-07-26T15:35:12.957 INFO:teuthology.orchestra.run.smithi197.stdout:Adding group ceph....done 2021-07-26T15:35:13.167 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up ceph-mgr (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:35:13.350 INFO:teuthology.orchestra.run.smithi197.stdout:Adding system user ceph....done 2021-07-26T15:35:13.397 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-07-26T15:35:13.398 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-07-26T15:35:13.535 INFO:teuthology.orchestra.run.smithi197.stdout:Setting system user ceph properties....done 2021-07-26T15:35:13.556 INFO:teuthology.orchestra.run.smithi197.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2021-07-26T15:35:13.705 INFO:teuthology.orchestra.run.smithi197.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-07-26T15:35:13.859 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up ceph-mgr-diskprediction-cloud (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:35:13.999 INFO:teuthology.orchestra.run.smithi197.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-07-26T15:35:14.001 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up ceph-osd (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:35:14.472 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up ceph-test (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:35:14.584 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-07-26T15:35:14.584 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-07-26T15:35:14.598 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up radosgw (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:35:14.874 INFO:teuthology.orchestra.run.smithi197.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-07-26T15:35:14.874 INFO:teuthology.orchestra.run.smithi197.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-07-26T15:35:15.037 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up ceph-mgr-k8sevents (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:35:15.163 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up ceph-mgr-diskprediction-local (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:35:15.331 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up ceph-mon (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:35:15.516 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up ceph-base (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:35:15.559 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-07-26T15:35:15.560 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-07-26T15:35:15.886 INFO:teuthology.orchestra.run.smithi197.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-07-26T15:35:16.026 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up ceph-mgr-cephadm (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:35:16.169 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up ceph (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:35:16.310 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up ceph-mds (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:35:16.322 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up ceph-mgr-dashboard (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:35:16.466 INFO:teuthology.orchestra.run.smithi183.stdout:Processing triggers for systemd (245.4-4ubuntu3.4) ... 2021-07-26T15:35:16.555 INFO:teuthology.orchestra.run.smithi197.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-07-26T15:35:16.555 INFO:teuthology.orchestra.run.smithi197.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-07-26T15:35:16.743 INFO:teuthology.orchestra.run.smithi183.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-07-26T15:35:17.012 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up ceph-mgr (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:35:17.249 INFO:teuthology.orchestra.run.smithi197.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-07-26T15:35:17.250 INFO:teuthology.orchestra.run.smithi197.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-07-26T15:35:17.673 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up ceph-mgr-diskprediction-cloud (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:35:17.805 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up ceph-osd (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:35:18.306 INFO:teuthology.orchestra.run.smithi197.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-07-26T15:35:18.306 INFO:teuthology.orchestra.run.smithi197.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-07-26T15:35:18.732 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up ceph-mgr-k8sevents (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:35:18.842 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up ceph-mgr-diskprediction-local (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:35:18.981 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up ceph-mon (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:35:19.211 INFO:teuthology.orchestra.run.smithi197.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-07-26T15:35:19.212 INFO:teuthology.orchestra.run.smithi197.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-07-26T15:35:19.648 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up ceph-mgr-cephadm (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:35:19.769 INFO:teuthology.orchestra.run.smithi183.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-07-26T15:35:19.791 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up ceph (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:35:19.934 INFO:teuthology.orchestra.run.smithi197.stdout:Setting up ceph-mgr-dashboard (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:35:20.053 INFO:teuthology.orchestra.run.smithi197.stdout:Processing triggers for systemd (245.4-4ubuntu3.4) ... 2021-07-26T15:35:20.199 INFO:teuthology.orchestra.run.smithi183.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-07-26T15:35:20.202 DEBUG:teuthology.parallel:result is None 2021-07-26T15:35:20.320 INFO:teuthology.orchestra.run.smithi197.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-07-26T15:35:23.390 INFO:teuthology.orchestra.run.smithi197.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-07-26T15:35:23.796 INFO:teuthology.orchestra.run.smithi197.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-07-26T15:35:23.801 DEBUG:teuthology.parallel:result is None 2021-07-26T15:35:23.802 DEBUG:teuthology.orchestra.run.smithi183:> sudo lsb_release -is 2021-07-26T15:35:23.854 INFO:teuthology.orchestra.run.smithi183.stdout:Ubuntu 2021-07-26T15:35:23.860 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-07-26T15:35:23.860 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-07-26T15:35:23.861 INFO:teuthology.packaging:ref: None 2021-07-26T15:35:23.861 INFO:teuthology.packaging:tag: None 2021-07-26T15:35:23.861 INFO:teuthology.packaging:branch: octopus 2021-07-26T15:35:23.862 INFO:teuthology.packaging:sha1: bccf07c244ef1754a7e8d345570b6a04f2ee5a7e 2021-07-26T15:35:23.862 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=octopus 2021-07-26T15:35:24.129 DEBUG:teuthology.orchestra.run.smithi183:> dpkg-query -W -f '${Version}' ceph 2021-07-26T15:35:24.151 INFO:teuthology.orchestra.run.smithi183.stdout:15.2.13-213-g0f589fd5-1focal 2021-07-26T15:35:24.152 INFO:teuthology.packaging:The installed version of ceph is 15.2.13-213-g0f589fd5-1focal 2021-07-26T15:35:24.153 INFO:teuthology.task.install:The correct ceph version 15.2.13-213-g0f589fd5-1focal is installed. 2021-07-26T15:35:24.153 DEBUG:teuthology.orchestra.run.smithi197:> sudo lsb_release -is 2021-07-26T15:35:24.205 INFO:teuthology.orchestra.run.smithi197.stdout:Ubuntu 2021-07-26T15:35:24.210 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-07-26T15:35:24.211 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-07-26T15:35:24.211 INFO:teuthology.packaging:ref: None 2021-07-26T15:35:24.212 INFO:teuthology.packaging:tag: None 2021-07-26T15:35:24.212 INFO:teuthology.packaging:branch: octopus 2021-07-26T15:35:24.212 INFO:teuthology.packaging:sha1: bccf07c244ef1754a7e8d345570b6a04f2ee5a7e 2021-07-26T15:35:24.213 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=octopus 2021-07-26T15:35:24.446 DEBUG:teuthology.orchestra.run.smithi197:> dpkg-query -W -f '${Version}' ceph 2021-07-26T15:35:24.469 INFO:teuthology.orchestra.run.smithi197.stdout:15.2.13-213-g0f589fd5-1focal 2021-07-26T15:35:24.471 INFO:teuthology.packaging:The installed version of ceph is 15.2.13-213-g0f589fd5-1focal 2021-07-26T15:35:24.471 INFO:teuthology.task.install:The correct ceph version 15.2.13-213-g0f589fd5-1focal is installed. 2021-07-26T15:35:24.472 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2021-07-26T15:35:24.472 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2021-07-26T15:35:24.472 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-07-26T15:35:24.488 DEBUG:teuthology.orchestra.run.smithi197:> set -ex 2021-07-26T15:35:24.488 DEBUG:teuthology.orchestra.run.smithi197:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-07-26T15:35:24.529 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2021-07-26T15:35:24.530 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2021-07-26T15:35:24.530 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/usr/bin/daemon-helper 2021-07-26T15:35:24.548 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-07-26T15:35:24.606 DEBUG:teuthology.orchestra.run.smithi197:> set -ex 2021-07-26T15:35:24.606 DEBUG:teuthology.orchestra.run.smithi197:> sudo dd of=/usr/bin/daemon-helper 2021-07-26T15:35:24.623 DEBUG:teuthology.orchestra.run.smithi197:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-07-26T15:35:24.681 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2021-07-26T15:35:24.682 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2021-07-26T15:35:24.682 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/usr/bin/adjust-ulimits 2021-07-26T15:35:24.698 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-07-26T15:35:24.713 DEBUG:teuthology.orchestra.run.smithi197:> set -ex 2021-07-26T15:35:24.714 DEBUG:teuthology.orchestra.run.smithi197:> sudo dd of=/usr/bin/adjust-ulimits 2021-07-26T15:35:24.730 DEBUG:teuthology.orchestra.run.smithi197:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-07-26T15:35:24.788 INFO:teuthology.run_tasks:Running task ceph... 2021-07-26T15:35:24.860 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2021-07-26T15:35:24.862 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 777 /var/log/ceph 2021-07-26T15:35:24.864 DEBUG:teuthology.orchestra.run.smithi197:> sudo chmod 777 /var/log/ceph 2021-07-26T15:35:24.880 INFO:tasks.ceph:Disabling ceph logrotate... 2021-07-26T15:35:24.881 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -f -- /etc/logrotate.d/ceph 2021-07-26T15:35:24.884 DEBUG:teuthology.orchestra.run.smithi197:> sudo rm -f -- /etc/logrotate.d/ceph 2021-07-26T15:35:24.899 INFO:tasks.ceph:Creating extra log directories... 2021-07-26T15:35:24.899 DEBUG:teuthology.orchestra.run.smithi183:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-07-26T15:35:24.902 DEBUG:teuthology.orchestra.run.smithi197:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-07-26T15:35:24.967 INFO:tasks.ceph:Creating ceph cluster c1... 2021-07-26T15:35:24.968 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon_warn_on_insecure_global_id_reclaim': False, 'mon_warn_on_insecure_global_id_reclaim_allowed': False}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)'], 'cpu_profile': set(), 'cluster': 'c1', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2021-07-26T15:35:24.968 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/sage-2021-07-26_15:05:01-upgrade-wip-kefu-testing-2021-07-24-1158-distro-basic-smithi/6293836', 'branch': 'wip-kefu-testing-2021-07-24-1158', 'description': 'upgrade/octopus-x/rgw-multisite/{clusters frontend overrides realm tasks upgrade/primary}', 'email': None, 'first_in_suite': False, 'job_id': '6293836', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'sage-2021-07-26_15:05:01-upgrade-wip-kefu-testing-2021-07-24-1158-distro-basic-smithi', 'nuke-on-error': True, 'overrides': {'admin_socket': {'branch': 'wip-kefu-testing-2021-07-24-1158'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon_warn_on_insecure_global_id_reclaim': False, 'mon_warn_on_insecure_global_id_reclaim_allowed': False}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'bccf07c244ef1754a7e8d345570b6a04f2ee5a7e', 'wait-for-scrub': False}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'branch': 'octopus', 'sha1': 'bccf07c244ef1754a7e8d345570b6a04f2ee5a7e'}}, 'rgw': {'compression type': 'random', 'frontend': 'beast'}, 'rgw-multisite': {'realm': {'is default': True, 'name': 'test-realm'}, 'zonegroups': [{'endpoints': ['c1.client.0'], 'is_default': True, 'is_master': True, 'name': 'test-zonegroup', 'zones': [{'endpoints': ['c1.client.0'], 'is_default': True, 'is_master': True, 'name': 'test-zone1'}, {'endpoints': ['c2.client.0'], 'is_default': True, 'name': 'test-zone2'}, {'endpoints': ['c2.client.1'], 'is_pubsub': True, 'name': 'test-zone3'}]}]}, 'rgw-multisite-tests': {'args': ['tests.py', 'tests_ps.py'], 'branch': 'octopus', 'repo': 'https://github.com/ceph/ceph.git'}, 'workunit': {'branch': 'wip-kefu-testing-2021-07-24-1158', 'sha1': 'bccf07c244ef1754a7e8d345570b6a04f2ee5a7e'}}, 'owner': 'scheduled_sage@teuthology', 'priority': 90, 'repo': 'git://git.ceph.com/ceph-ci.git', 'roles': [['c1.mon.a', 'c1.mgr.x', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0'], ['c2.mon.a', 'c2.mgr.x', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0', 'c2.client.1']], 'sha1': 'bccf07c244ef1754a7e8d345570b6a04f2ee5a7e', 'sleep_before_teardown': 0, 'suite': 'upgrade', 'suite_branch': 'wip-kefu-testing-2021-07-24-1158', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_bccf07c244ef1754a7e8d345570b6a04f2ee5a7e/qa', 'suite_relpath': 'qa', 'suite_repo': 'git://git.ceph.com/ceph-ci.git', 'suite_sha1': 'bccf07c244ef1754a7e8d345570b6a04f2ee5a7e', 'targets': {'smithi183.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDD/GJaszGqYDRTECIV+64PPxcOAHJ+vlfdUHu65iDPSknSHUVWVzJH3bjocqSKANXzu7EqxzJi+OZEpIyuJYgBmAfIBQa8kHDDBiRus1zmD90lsolWAeQbxK9gopwWvJ1pa8Dpcd4m1+po67OuSBWcA90gKMkS9J/zbqQcVPQhrV2scHCiB0ezTKAcjfk3xYfMAmjq1jVBdkNa2IFR6opL4A1nfsx4/UBazSiJzqrLr+A21hywmFrJxzuZ4Mh539B3AuxuqBsJqoTrAkMwGiSofYmgf5WxsRhQTwXT2oT+tRFt4anWQ9Q7VHkpIuBA1Us031GiEaGEeBkQgUINsBB26+b8+zxc9Dmg4Z4SUz7AxvTr8liOLfpfv3+PW8yUE27+gQ1AxO5YQS9cBQrSAAlTPTFyrK5OjSHPGNUKNb6MfFCbm/8XpRddA1Ou8OfOFTloBCscnMVZ6wI4ME6wjG/Y/YbzN69JMMKmtQZUNE+hfE7oxRMd13a4LxoL7dK3d10=', 'smithi197.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDGMPwfQjgrFUV1MRh9ksGbxFWOU2Zlm6eRIroOSl506mwAY74uYgvVew8jXHh1JtsBBRj/TepKgy65HLgqT3unQ3vXXXbRCtRhiTQeBhc3w5t+YbD1y+rpvFpc7RoFh6F92/s7Wstt7D9QlSLu10QTw6MWTcK46BG1e5jJYWLf2PM/HAJtKiJB3sKsQKaXSwYTKhwXVESW76uXf/SwAs3Qe2+uYCjIYrQqTJXDHu53IpuAcCkwJKNkhSbPMWQgH77L5fnvflWL50BkVEFpwgCWkFH464fl1N2v/l+aFkTkzDmX/Z9fDSK2JduuUmAXpkEMh40J4pFbLgP7qao/VJTkMA/JeWDN6D96G230WjRemPdd4M+Puz/WJUUQjRY/4Uojd70AI+n+zTXNEqr8DGuNbZPk/1+DIW22udhqYSFw8GWpyVN4IAbJWxlBCGi246P2+0/DymNFlBY7AzobipHkS81+Qn/ZnHG2en7GKWrov8jc4kf8HUCrJSAptXLUBkU='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'cluster': 'c1', 'conf': {'client': {'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon_warn_on_insecure_global_id_reclaim': False, 'mon_warn_on_insecure_global_id_reclaim_allowed': False}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'bccf07c244ef1754a7e8d345570b6a04f2ee5a7e', 'wait-for-scrub': False}}, {'ceph': {'cluster': 'c2'}}, {'parallel': ['upgrade-task']}, {'rgw': {'c1.client.0': {'port': 8000}, 'c2.client.0': {'port': 8000}, 'c2.client.1': {'port': 8001}}}, {'rgw-multisite': None}, {'rgw-multisite-tests': {'config': {'reconfigure_delay': 60}}}], 'teuthology_branch': 'master', 'teuthology_sha1': 'b6f3efab84b70e18e86ec271a07564aeb4ed3bac', 'timestamp': '2021-07-26_15:05:01', 'tube': 'smithi', 'upgrade-task': [{'install.upgrade': {'c1.client.0': None, 'c1.mgr.x': None, 'c1.mon.a': None, 'c1.osd.0': None, 'c1.osd.1': None, 'c1.osd.2': None}}], 'user': 'sage', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.30581'} 2021-07-26T15:35:24.969 DEBUG:teuthology.orchestra.run.smithi183:> install -d -m0755 -- /home/ubuntu/cephtest/c1.data 2021-07-26T15:35:24.972 DEBUG:teuthology.orchestra.run.smithi197:> install -d -m0755 -- /home/ubuntu/cephtest/c1.data 2021-07-26T15:35:24.979 DEBUG:teuthology.orchestra.run.smithi183:> sudo install -d -m0777 -- /var/run/ceph 2021-07-26T15:35:24.981 DEBUG:teuthology.orchestra.run.smithi197:> sudo install -d -m0777 -- /var/run/ceph 2021-07-26T15:35:24.995 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2021-07-26T15:35:24.995 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/scratch_devs of=/dev/stdout 2021-07-26T15:35:25.042 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-07-26T15:35:25.043 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-07-26T15:35:25.050 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-07-26T15:35:25.050 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-07-26T15:35:25.051 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 6h/6d Inode: 348 Links: 1 2021-07-26T15:35:25.051 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-07-26T15:35:25.051 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2021-07-26 15:32:23.153121629 +0000 2021-07-26T15:35:25.051 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2021-07-26 15:32:23.149121629 +0000 2021-07-26T15:35:25.052 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2021-07-26 15:32:23.149121629 +0000 2021-07-26T15:35:25.052 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: - 2021-07-26T15:35:25.061 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2021-07-26T15:35:25.061 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2021-07-26T15:35:25.061 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.000403754 s, 1.3 MB/s 2021-07-26T15:35:25.066 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-07-26T15:35:25.073 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-07-26T15:35:25.074 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-07-26T15:35:25.074 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 6h/6d Inode: 355 Links: 1 2021-07-26T15:35:25.074 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-07-26T15:35:25.074 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2021-07-26 15:32:23.709121623 +0000 2021-07-26T15:35:25.075 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2021-07-26 15:32:23.557121624 +0000 2021-07-26T15:35:25.075 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2021-07-26 15:32:23.557121624 +0000 2021-07-26T15:35:25.075 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: - 2021-07-26T15:35:25.081 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2021-07-26T15:35:25.081 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2021-07-26T15:35:25.082 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.000377116 s, 1.4 MB/s 2021-07-26T15:35:25.086 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-07-26T15:35:25.134 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-07-26T15:35:25.134 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-07-26T15:35:25.135 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 6h/6d Inode: 361 Links: 1 2021-07-26T15:35:25.135 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-07-26T15:35:25.135 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2021-07-26 15:32:24.125121618 +0000 2021-07-26T15:35:25.135 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2021-07-26 15:32:23.981121620 +0000 2021-07-26T15:35:25.136 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2021-07-26 15:32:23.981121620 +0000 2021-07-26T15:35:25.136 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: - 2021-07-26T15:35:25.144 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2021-07-26T15:35:25.145 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2021-07-26T15:35:25.145 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.000392121 s, 1.3 MB/s 2021-07-26T15:35:25.149 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-07-26T15:35:25.157 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-07-26T15:35:25.157 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-07-26T15:35:25.158 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 6h/6d Inode: 365 Links: 1 2021-07-26T15:35:25.158 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-07-26T15:35:25.158 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2021-07-26 15:32:24.497121614 +0000 2021-07-26T15:35:25.159 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2021-07-26 15:32:24.333121616 +0000 2021-07-26T15:35:25.159 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2021-07-26 15:32:24.333121616 +0000 2021-07-26T15:35:25.159 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: - 2021-07-26T15:35:25.164 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2021-07-26T15:35:25.164 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2021-07-26T15:35:25.164 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.000386737 s, 1.3 MB/s 2021-07-26T15:35:25.168 INFO:tasks.ceph:osd dev map: {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'} 2021-07-26T15:35:25.168 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi183.front.sepia.ceph.com'): {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'}} 2021-07-26T15:35:25.169 INFO:tasks.ceph:Generating config... 2021-07-26T15:35:25.171 INFO:tasks.ceph:[client] debug rgw = 20 2021-07-26T15:35:25.172 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2021-07-26T15:35:25.172 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2021-07-26T15:35:25.172 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2021-07-26T15:35:25.173 INFO:tasks.ceph:[client] rgw curl low speed time = 300 2021-07-26T15:35:25.173 INFO:tasks.ceph:[client] rgw data log num shards = 4 2021-07-26T15:35:25.173 INFO:tasks.ceph:[client] rgw md log max shards = 4 2021-07-26T15:35:25.173 INFO:tasks.ceph:[client] rgw sync log trim interval = 0 2021-07-26T15:35:25.174 INFO:tasks.ceph:[client] rgw sync obj etag verify = True 2021-07-26T15:35:25.174 INFO:tasks.ceph:[client] setgroup = ceph 2021-07-26T15:35:25.174 INFO:tasks.ceph:[client] setuser = ceph 2021-07-26T15:35:25.175 INFO:tasks.ceph:[mgr] debug mgr = 20 2021-07-26T15:35:25.175 INFO:tasks.ceph:[mgr] debug ms = 1 2021-07-26T15:35:25.175 INFO:tasks.ceph:[mon] debug mon = 20 2021-07-26T15:35:25.176 INFO:tasks.ceph:[mon] debug ms = 1 2021-07-26T15:35:25.176 INFO:tasks.ceph:[mon] debug paxos = 20 2021-07-26T15:35:25.176 INFO:tasks.ceph:[mon] mon_warn_on_insecure_global_id_reclaim = False 2021-07-26T15:35:25.176 INFO:tasks.ceph:[mon] mon_warn_on_insecure_global_id_reclaim_allowed = False 2021-07-26T15:35:25.177 INFO:tasks.ceph:[osd] debug ms = 1 2021-07-26T15:35:25.177 INFO:tasks.ceph:[osd] debug osd = 20 2021-07-26T15:35:25.178 INFO:tasks.ceph:Setting up c1.mon.a... 2021-07-26T15:35:25.178 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/c1.keyring 2021-07-26T15:35:25.232 INFO:teuthology.orchestra.run.smithi183.stdout:creating /etc/ceph/c1.keyring 2021-07-26T15:35:25.236 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/c1.keyring 2021-07-26T15:35:25.268 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 0644 /etc/ceph/c1.keyring 2021-07-26T15:35:25.281 DEBUG:tasks.ceph:Ceph mon addresses: [('c1.mon.a', '172.21.15.183')] 2021-07-26T15:35:25.282 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.183'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug osd': 20}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': False, 'mon_warn_on_insecure_global_id_reclaim_allowed': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2021-07-26T15:35:25.283 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2021-07-26T15:35:25.284 DEBUG:teuthology.orchestra.run.smithi183:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2021-07-26T15:35:25.289 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.183 --print /home/ubuntu/cephtest/c1.monmap 2021-07-26T15:35:25.360 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:35:25.361 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:35:25.362 INFO:teuthology.orchestra.run.smithi183.stdout:monmaptool: monmap file /home/ubuntu/cephtest/c1.monmap 2021-07-26T15:35:25.363 INFO:teuthology.orchestra.run.smithi183.stdout:monmaptool: generated fsid 8e1b7cac-42bd-407f-81ac-24faa0e6ffe5 2021-07-26T15:35:25.363 INFO:teuthology.orchestra.run.smithi183.stdout:epoch 0 2021-07-26T15:35:25.363 INFO:teuthology.orchestra.run.smithi183.stdout:fsid 8e1b7cac-42bd-407f-81ac-24faa0e6ffe5 2021-07-26T15:35:25.363 INFO:teuthology.orchestra.run.smithi183.stdout:last_changed 2021-07-26T15:35:25.370710+0000 2021-07-26T15:35:25.364 INFO:teuthology.orchestra.run.smithi183.stdout:created 2021-07-26T15:35:25.370710+0000 2021-07-26T15:35:25.364 INFO:teuthology.orchestra.run.smithi183.stdout:min_mon_release 0 (unknown) 2021-07-26T15:35:25.364 INFO:teuthology.orchestra.run.smithi183.stdout:0: [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] mon.a 2021-07-26T15:35:25.364 INFO:teuthology.orchestra.run.smithi183.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/c1.monmap (1 monitors) 2021-07-26T15:35:25.365 DEBUG:teuthology.orchestra.run.smithi183:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2021-07-26T15:35:25.372 INFO:tasks.ceph:Writing /etc/ceph/c1.conf for FSID 8e1b7cac-42bd-407f-81ac-24faa0e6ffe5... 2021-07-26T15:35:25.373 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/c1.conf && sudo chmod 0644 /etc/ceph/c1.conf > /dev/null 2021-07-26T15:35:25.416 DEBUG:teuthology.orchestra.run.smithi197:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/c1.conf && sudo chmod 0644 /etc/ceph/c1.conf > /dev/null 2021-07-26T15:35:25.445 INFO:teuthology.orchestra.run.smithi183.stdout:[global] 2021-07-26T15:35:25.445 INFO:teuthology.orchestra.run.smithi183.stdout: chdir = "" 2021-07-26T15:35:25.445 INFO:teuthology.orchestra.run.smithi183.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-07-26T15:35:25.445 INFO:teuthology.orchestra.run.smithi183.stdout: auth supported = cephx 2021-07-26T15:35:25.446 INFO:teuthology.orchestra.run.smithi183.stdout: 2021-07-26T15:35:25.447 INFO:teuthology.orchestra.run.smithi183.stdout: filestore xattr use omap = true 2021-07-26T15:35:25.447 INFO:teuthology.orchestra.run.smithi183.stdout: 2021-07-26T15:35:25.447 INFO:teuthology.orchestra.run.smithi183.stdout: mon clock drift allowed = 1.000 2021-07-26T15:35:25.447 INFO:teuthology.orchestra.run.smithi183.stdout: 2021-07-26T15:35:25.448 INFO:teuthology.orchestra.run.smithi183.stdout: osd crush chooseleaf type = 0 2021-07-26T15:35:25.448 INFO:teuthology.orchestra.run.smithi183.stdout: auth debug = true 2021-07-26T15:35:25.448 INFO:teuthology.orchestra.run.smithi183.stdout: 2021-07-26T15:35:25.448 INFO:teuthology.orchestra.run.smithi183.stdout: ms die on old message = true 2021-07-26T15:35:25.448 INFO:teuthology.orchestra.run.smithi183.stdout: ms die on bug = true 2021-07-26T15:35:25.449 INFO:teuthology.orchestra.run.smithi183.stdout: 2021-07-26T15:35:25.449 INFO:teuthology.orchestra.run.smithi183.stdout: mon max pg per osd = 10000 # >= luminous 2021-07-26T15:35:25.449 INFO:teuthology.orchestra.run.smithi183.stdout: mon pg warn max object skew = 0 2021-07-26T15:35:25.449 INFO:teuthology.orchestra.run.smithi183.stdout: 2021-07-26T15:35:25.450 INFO:teuthology.orchestra.run.smithi183.stdout: # disable pg_autoscaler by default for new pools 2021-07-26T15:35:25.450 INFO:teuthology.orchestra.run.smithi183.stdout: osd_pool_default_pg_autoscale_mode = off 2021-07-26T15:35:25.450 INFO:teuthology.orchestra.run.smithi183.stdout: 2021-07-26T15:35:25.450 INFO:teuthology.orchestra.run.smithi183.stdout: osd pool default size = 2 2021-07-26T15:35:25.450 INFO:teuthology.orchestra.run.smithi183.stdout: 2021-07-26T15:35:25.451 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd allow primary affinity = true 2021-07-26T15:35:25.451 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd allow pg remap = true 2021-07-26T15:35:25.451 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on legacy crush tunables = false 2021-07-26T15:35:25.451 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on crush straw calc version zero = false 2021-07-26T15:35:25.452 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on no sortbitwise = false 2021-07-26T15:35:25.452 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on osd down out interval zero = false 2021-07-26T15:35:25.452 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on too few osds = false 2021-07-26T15:35:25.452 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-07-26T15:35:25.452 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_pool_no_redundancy = false 2021-07-26T15:35:25.453 INFO:teuthology.orchestra.run.smithi183.stdout: mon_allow_pool_size_one = true 2021-07-26T15:35:25.453 INFO:teuthology.orchestra.run.smithi183.stdout: 2021-07-26T15:35:25.453 INFO:teuthology.orchestra.run.smithi183.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2021-07-26T15:35:25.453 INFO:teuthology.orchestra.run.smithi183.stdout: 2021-07-26T15:35:25.454 INFO:teuthology.orchestra.run.smithi183.stdout: osd default data pool replay window = 5 2021-07-26T15:35:25.454 INFO:teuthology.orchestra.run.smithi183.stdout: 2021-07-26T15:35:25.454 INFO:teuthology.orchestra.run.smithi183.stdout: mon allow pool delete = true 2021-07-26T15:35:25.454 INFO:teuthology.orchestra.run.smithi183.stdout: 2021-07-26T15:35:25.455 INFO:teuthology.orchestra.run.smithi183.stdout: mon cluster log file level = debug 2021-07-26T15:35:25.455 INFO:teuthology.orchestra.run.smithi183.stdout: debug asserts on shutdown = true 2021-07-26T15:35:25.455 INFO:teuthology.orchestra.run.smithi183.stdout: mon health detail to clog = false 2021-07-26T15:35:25.455 INFO:teuthology.orchestra.run.smithi183.stdout: mon host = 172.21.15.183 2021-07-26T15:35:25.455 INFO:teuthology.orchestra.run.smithi183.stdout: fsid = 8e1b7cac-42bd-407f-81ac-24faa0e6ffe5 2021-07-26T15:35:25.456 INFO:teuthology.orchestra.run.smithi183.stdout: 2021-07-26T15:35:25.456 INFO:teuthology.orchestra.run.smithi183.stdout:[osd] 2021-07-26T15:35:25.456 INFO:teuthology.orchestra.run.smithi183.stdout: osd journal size = 100 2021-07-26T15:35:25.456 INFO:teuthology.orchestra.run.smithi183.stdout: 2021-07-26T15:35:25.457 INFO:teuthology.orchestra.run.smithi183.stdout: osd scrub load threshold = 5.0 2021-07-26T15:35:25.457 INFO:teuthology.orchestra.run.smithi183.stdout: osd scrub max interval = 600 2021-07-26T15:35:25.457 INFO:teuthology.orchestra.run.smithi183.stdout: 2021-07-26T15:35:25.457 INFO:teuthology.orchestra.run.smithi183.stdout: osd recover clone overlap = true 2021-07-26T15:35:25.457 INFO:teuthology.orchestra.run.smithi183.stdout: osd recovery max chunk = 1048576 2021-07-26T15:35:25.458 INFO:teuthology.orchestra.run.smithi183.stdout: 2021-07-26T15:35:25.458 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug shutdown = true 2021-07-26T15:35:25.458 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug op order = true 2021-07-26T15:35:25.458 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug verify stray on activate = true 2021-07-26T15:35:25.459 INFO:teuthology.orchestra.run.smithi183.stdout: 2021-07-26T15:35:25.459 INFO:teuthology.orchestra.run.smithi183.stdout: osd open classes on start = true 2021-07-26T15:35:25.459 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug pg log writeout = true 2021-07-26T15:35:25.459 INFO:teuthology.orchestra.run.smithi183.stdout: 2021-07-26T15:35:25.459 INFO:teuthology.orchestra.run.smithi183.stdout: osd deep scrub update digest min age = 30 2021-07-26T15:35:25.460 INFO:teuthology.orchestra.run.smithi183.stdout: 2021-07-26T15:35:25.460 INFO:teuthology.orchestra.run.smithi183.stdout: osd map max advance = 10 2021-07-26T15:35:25.460 INFO:teuthology.orchestra.run.smithi183.stdout: 2021-07-26T15:35:25.460 INFO:teuthology.orchestra.run.smithi183.stdout: journal zero on create = true 2021-07-26T15:35:25.461 INFO:teuthology.orchestra.run.smithi183.stdout: 2021-07-26T15:35:25.461 INFO:teuthology.orchestra.run.smithi183.stdout: filestore ondisk finisher threads = 3 2021-07-26T15:35:25.461 INFO:teuthology.orchestra.run.smithi183.stdout: filestore apply finisher threads = 3 2021-07-26T15:35:25.461 INFO:teuthology.orchestra.run.smithi183.stdout: 2021-07-26T15:35:25.461 INFO:teuthology.orchestra.run.smithi183.stdout: bdev debug aio = true 2021-07-26T15:35:25.462 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug misdirected ops = true 2021-07-26T15:35:25.462 INFO:teuthology.orchestra.run.smithi183.stdout: debug ms = 1 2021-07-26T15:35:25.462 INFO:teuthology.orchestra.run.smithi183.stdout: debug osd = 20 2021-07-26T15:35:25.462 INFO:teuthology.orchestra.run.smithi183.stdout: 2021-07-26T15:35:25.463 INFO:teuthology.orchestra.run.smithi183.stdout:[mgr] 2021-07-26T15:35:25.463 INFO:teuthology.orchestra.run.smithi183.stdout: debug ms = 1 2021-07-26T15:35:25.463 INFO:teuthology.orchestra.run.smithi183.stdout: debug mgr = 20 2021-07-26T15:35:25.463 INFO:teuthology.orchestra.run.smithi183.stdout: debug mon = 20 2021-07-26T15:35:25.463 INFO:teuthology.orchestra.run.smithi183.stdout: debug auth = 20 2021-07-26T15:35:25.464 INFO:teuthology.orchestra.run.smithi183.stdout: mon reweight min pgs per osd = 4 2021-07-26T15:35:25.464 INFO:teuthology.orchestra.run.smithi183.stdout: mon reweight min bytes per osd = 10 2021-07-26T15:35:25.464 INFO:teuthology.orchestra.run.smithi183.stdout: mgr/telemetry/nag = false 2021-07-26T15:35:25.464 INFO:teuthology.orchestra.run.smithi183.stdout: 2021-07-26T15:35:25.465 INFO:teuthology.orchestra.run.smithi183.stdout:[mon] 2021-07-26T15:35:25.465 INFO:teuthology.orchestra.run.smithi183.stdout: debug ms = 1 2021-07-26T15:35:25.465 INFO:teuthology.orchestra.run.smithi183.stdout: debug mon = 20 2021-07-26T15:35:25.465 INFO:teuthology.orchestra.run.smithi183.stdout: debug paxos = 20 2021-07-26T15:35:25.465 INFO:teuthology.orchestra.run.smithi183.stdout: debug auth = 20 2021-07-26T15:35:25.466 INFO:teuthology.orchestra.run.smithi183.stdout: mon data avail warn = 5 2021-07-26T15:35:25.466 INFO:teuthology.orchestra.run.smithi183.stdout: mon mgr mkfs grace = 240 2021-07-26T15:35:25.466 INFO:teuthology.orchestra.run.smithi183.stdout: mon reweight min pgs per osd = 4 2021-07-26T15:35:25.466 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd reporter subtree level = osd 2021-07-26T15:35:25.466 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd prime pg temp = true 2021-07-26T15:35:25.467 INFO:teuthology.orchestra.run.smithi183.stdout: mon reweight min bytes per osd = 10 2021-07-26T15:35:25.467 INFO:teuthology.orchestra.run.smithi183.stdout: 2021-07-26T15:35:25.467 INFO:teuthology.orchestra.run.smithi183.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-07-26T15:35:25.467 INFO:teuthology.orchestra.run.smithi183.stdout: auth mon ticket ttl = 660 # 11m 2021-07-26T15:35:25.468 INFO:teuthology.orchestra.run.smithi183.stdout: auth service ticket ttl = 240 # 4m 2021-07-26T15:35:25.468 INFO:teuthology.orchestra.run.smithi183.stdout: 2021-07-26T15:35:25.468 INFO:teuthology.orchestra.run.smithi183.stdout: # don't complain about insecure global_id in the test suite 2021-07-26T15:35:25.468 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_insecure_global_id_reclaim = False 2021-07-26T15:35:25.468 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = False 2021-07-26T15:35:25.469 INFO:teuthology.orchestra.run.smithi183.stdout: 2021-07-26T15:35:25.469 INFO:teuthology.orchestra.run.smithi183.stdout:[client] 2021-07-26T15:35:25.469 INFO:teuthology.orchestra.run.smithi183.stdout: rgw cache enabled = true 2021-07-26T15:35:25.469 INFO:teuthology.orchestra.run.smithi183.stdout: rgw enable ops log = true 2021-07-26T15:35:25.470 INFO:teuthology.orchestra.run.smithi183.stdout: rgw enable usage log = true 2021-07-26T15:35:25.470 INFO:teuthology.orchestra.run.smithi183.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-07-26T15:35:25.470 INFO:teuthology.orchestra.run.smithi183.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-07-26T15:35:25.470 INFO:teuthology.orchestra.run.smithi183.stdout: debug rgw = 20 2021-07-26T15:35:25.471 INFO:teuthology.orchestra.run.smithi183.stdout: rgw crypt require ssl = False 2021-07-26T15:35:25.471 INFO:teuthology.orchestra.run.smithi183.stdout: rgw crypt s3 kms backend = testing 2021-07-26T15:35:25.471 INFO:teuthology.orchestra.run.smithi183.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2021-07-26T15:35:25.471 INFO:teuthology.orchestra.run.smithi183.stdout: rgw curl low speed time = 300 2021-07-26T15:35:25.471 INFO:teuthology.orchestra.run.smithi183.stdout: rgw data log num shards = 4 2021-07-26T15:35:25.472 INFO:teuthology.orchestra.run.smithi183.stdout: rgw md log max shards = 4 2021-07-26T15:35:25.472 INFO:teuthology.orchestra.run.smithi183.stdout: rgw sync log trim interval = 0 2021-07-26T15:35:25.472 INFO:teuthology.orchestra.run.smithi183.stdout: rgw sync obj etag verify = True 2021-07-26T15:35:25.472 INFO:teuthology.orchestra.run.smithi183.stdout: setgroup = ceph 2021-07-26T15:35:25.473 INFO:teuthology.orchestra.run.smithi183.stdout: setuser = ceph 2021-07-26T15:35:25.473 INFO:teuthology.orchestra.run.smithi183.stdout:[mon.a] 2021-07-26T15:35:25.475 INFO:teuthology.orchestra.run.smithi197.stdout:[global] 2021-07-26T15:35:25.475 INFO:teuthology.orchestra.run.smithi197.stdout: chdir = "" 2021-07-26T15:35:25.475 INFO:teuthology.orchestra.run.smithi197.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-07-26T15:35:25.475 INFO:teuthology.orchestra.run.smithi197.stdout: auth supported = cephx 2021-07-26T15:35:25.476 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-07-26T15:35:25.476 INFO:teuthology.orchestra.run.smithi197.stdout: filestore xattr use omap = true 2021-07-26T15:35:25.476 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-07-26T15:35:25.476 INFO:teuthology.orchestra.run.smithi197.stdout: mon clock drift allowed = 1.000 2021-07-26T15:35:25.476 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-07-26T15:35:25.477 INFO:teuthology.orchestra.run.smithi197.stdout: osd crush chooseleaf type = 0 2021-07-26T15:35:25.477 INFO:teuthology.orchestra.run.smithi197.stdout: auth debug = true 2021-07-26T15:35:25.477 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-07-26T15:35:25.477 INFO:teuthology.orchestra.run.smithi197.stdout: ms die on old message = true 2021-07-26T15:35:25.478 INFO:teuthology.orchestra.run.smithi197.stdout: ms die on bug = true 2021-07-26T15:35:25.478 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-07-26T15:35:25.478 INFO:teuthology.orchestra.run.smithi197.stdout: mon max pg per osd = 10000 # >= luminous 2021-07-26T15:35:25.478 INFO:teuthology.orchestra.run.smithi197.stdout: mon pg warn max object skew = 0 2021-07-26T15:35:25.478 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-07-26T15:35:25.479 INFO:teuthology.orchestra.run.smithi197.stdout: # disable pg_autoscaler by default for new pools 2021-07-26T15:35:25.479 INFO:teuthology.orchestra.run.smithi197.stdout: osd_pool_default_pg_autoscale_mode = off 2021-07-26T15:35:25.479 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-07-26T15:35:25.479 INFO:teuthology.orchestra.run.smithi197.stdout: osd pool default size = 2 2021-07-26T15:35:25.480 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-07-26T15:35:25.480 INFO:teuthology.orchestra.run.smithi197.stdout: mon osd allow primary affinity = true 2021-07-26T15:35:25.480 INFO:teuthology.orchestra.run.smithi197.stdout: mon osd allow pg remap = true 2021-07-26T15:35:25.480 INFO:teuthology.orchestra.run.smithi197.stdout: mon warn on legacy crush tunables = false 2021-07-26T15:35:25.480 INFO:teuthology.orchestra.run.smithi197.stdout: mon warn on crush straw calc version zero = false 2021-07-26T15:35:25.481 INFO:teuthology.orchestra.run.smithi197.stdout: mon warn on no sortbitwise = false 2021-07-26T15:35:25.481 INFO:teuthology.orchestra.run.smithi197.stdout: mon warn on osd down out interval zero = false 2021-07-26T15:35:25.481 INFO:teuthology.orchestra.run.smithi197.stdout: mon warn on too few osds = false 2021-07-26T15:35:25.481 INFO:teuthology.orchestra.run.smithi197.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-07-26T15:35:25.482 INFO:teuthology.orchestra.run.smithi197.stdout: mon_warn_on_pool_no_redundancy = false 2021-07-26T15:35:25.482 INFO:teuthology.orchestra.run.smithi197.stdout: mon_allow_pool_size_one = true 2021-07-26T15:35:25.482 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-07-26T15:35:25.482 INFO:teuthology.orchestra.run.smithi197.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2021-07-26T15:35:25.483 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-07-26T15:35:25.483 INFO:teuthology.orchestra.run.smithi197.stdout: osd default data pool replay window = 5 2021-07-26T15:35:25.483 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-07-26T15:35:25.483 INFO:teuthology.orchestra.run.smithi197.stdout: mon allow pool delete = true 2021-07-26T15:35:25.483 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-07-26T15:35:25.484 INFO:teuthology.orchestra.run.smithi197.stdout: mon cluster log file level = debug 2021-07-26T15:35:25.484 INFO:teuthology.orchestra.run.smithi197.stdout: debug asserts on shutdown = true 2021-07-26T15:35:25.484 INFO:teuthology.orchestra.run.smithi197.stdout: mon health detail to clog = false 2021-07-26T15:35:25.484 INFO:teuthology.orchestra.run.smithi197.stdout: mon host = 172.21.15.183 2021-07-26T15:35:25.484 INFO:teuthology.orchestra.run.smithi197.stdout: fsid = 8e1b7cac-42bd-407f-81ac-24faa0e6ffe5 2021-07-26T15:35:25.485 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-07-26T15:35:25.485 INFO:teuthology.orchestra.run.smithi197.stdout:[osd] 2021-07-26T15:35:25.485 INFO:teuthology.orchestra.run.smithi197.stdout: osd journal size = 100 2021-07-26T15:35:25.485 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-07-26T15:35:25.486 INFO:teuthology.orchestra.run.smithi197.stdout: osd scrub load threshold = 5.0 2021-07-26T15:35:25.486 INFO:teuthology.orchestra.run.smithi197.stdout: osd scrub max interval = 600 2021-07-26T15:35:25.486 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-07-26T15:35:25.486 INFO:teuthology.orchestra.run.smithi197.stdout: osd recover clone overlap = true 2021-07-26T15:35:25.487 INFO:teuthology.orchestra.run.smithi197.stdout: osd recovery max chunk = 1048576 2021-07-26T15:35:25.487 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-07-26T15:35:25.487 INFO:teuthology.orchestra.run.smithi197.stdout: osd debug shutdown = true 2021-07-26T15:35:25.487 INFO:teuthology.orchestra.run.smithi197.stdout: osd debug op order = true 2021-07-26T15:35:25.487 INFO:teuthology.orchestra.run.smithi197.stdout: osd debug verify stray on activate = true 2021-07-26T15:35:25.488 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-07-26T15:35:25.488 INFO:teuthology.orchestra.run.smithi197.stdout: osd open classes on start = true 2021-07-26T15:35:25.488 INFO:teuthology.orchestra.run.smithi197.stdout: osd debug pg log writeout = true 2021-07-26T15:35:25.488 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-07-26T15:35:25.489 INFO:teuthology.orchestra.run.smithi197.stdout: osd deep scrub update digest min age = 30 2021-07-26T15:35:25.489 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-07-26T15:35:25.489 INFO:teuthology.orchestra.run.smithi197.stdout: osd map max advance = 10 2021-07-26T15:35:25.489 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-07-26T15:35:25.489 INFO:teuthology.orchestra.run.smithi197.stdout: journal zero on create = true 2021-07-26T15:35:25.490 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-07-26T15:35:25.490 INFO:teuthology.orchestra.run.smithi197.stdout: filestore ondisk finisher threads = 3 2021-07-26T15:35:25.490 INFO:teuthology.orchestra.run.smithi197.stdout: filestore apply finisher threads = 3 2021-07-26T15:35:25.490 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-07-26T15:35:25.491 INFO:teuthology.orchestra.run.smithi197.stdout: bdev debug aio = true 2021-07-26T15:35:25.491 INFO:teuthology.orchestra.run.smithi197.stdout: osd debug misdirected ops = true 2021-07-26T15:35:25.491 INFO:teuthology.orchestra.run.smithi197.stdout: debug ms = 1 2021-07-26T15:35:25.491 INFO:teuthology.orchestra.run.smithi197.stdout: debug osd = 20 2021-07-26T15:35:25.491 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-07-26T15:35:25.492 INFO:teuthology.orchestra.run.smithi197.stdout:[mgr] 2021-07-26T15:35:25.492 INFO:teuthology.orchestra.run.smithi197.stdout: debug ms = 1 2021-07-26T15:35:25.492 INFO:teuthology.orchestra.run.smithi197.stdout: debug mgr = 20 2021-07-26T15:35:25.492 INFO:teuthology.orchestra.run.smithi197.stdout: debug mon = 20 2021-07-26T15:35:25.493 INFO:teuthology.orchestra.run.smithi197.stdout: debug auth = 20 2021-07-26T15:35:25.493 INFO:teuthology.orchestra.run.smithi197.stdout: mon reweight min pgs per osd = 4 2021-07-26T15:35:25.493 INFO:teuthology.orchestra.run.smithi197.stdout: mon reweight min bytes per osd = 10 2021-07-26T15:35:25.493 INFO:teuthology.orchestra.run.smithi197.stdout: mgr/telemetry/nag = false 2021-07-26T15:35:25.493 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-07-26T15:35:25.494 INFO:teuthology.orchestra.run.smithi197.stdout:[mon] 2021-07-26T15:35:25.494 INFO:teuthology.orchestra.run.smithi197.stdout: debug ms = 1 2021-07-26T15:35:25.494 INFO:teuthology.orchestra.run.smithi197.stdout: debug mon = 20 2021-07-26T15:35:25.494 INFO:teuthology.orchestra.run.smithi197.stdout: debug paxos = 20 2021-07-26T15:35:25.495 INFO:teuthology.orchestra.run.smithi197.stdout: debug auth = 20 2021-07-26T15:35:25.495 INFO:teuthology.orchestra.run.smithi197.stdout: mon data avail warn = 5 2021-07-26T15:35:25.495 INFO:teuthology.orchestra.run.smithi197.stdout: mon mgr mkfs grace = 240 2021-07-26T15:35:25.495 INFO:teuthology.orchestra.run.smithi197.stdout: mon reweight min pgs per osd = 4 2021-07-26T15:35:25.495 INFO:teuthology.orchestra.run.smithi197.stdout: mon osd reporter subtree level = osd 2021-07-26T15:35:25.496 INFO:teuthology.orchestra.run.smithi197.stdout: mon osd prime pg temp = true 2021-07-26T15:35:25.496 INFO:teuthology.orchestra.run.smithi197.stdout: mon reweight min bytes per osd = 10 2021-07-26T15:35:25.496 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-07-26T15:35:25.496 INFO:teuthology.orchestra.run.smithi197.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-07-26T15:35:25.497 INFO:teuthology.orchestra.run.smithi197.stdout: auth mon ticket ttl = 660 # 11m 2021-07-26T15:35:25.497 INFO:teuthology.orchestra.run.smithi197.stdout: auth service ticket ttl = 240 # 4m 2021-07-26T15:35:25.497 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-07-26T15:35:25.497 INFO:teuthology.orchestra.run.smithi197.stdout: # don't complain about insecure global_id in the test suite 2021-07-26T15:35:25.497 INFO:teuthology.orchestra.run.smithi197.stdout: mon_warn_on_insecure_global_id_reclaim = False 2021-07-26T15:35:25.498 INFO:teuthology.orchestra.run.smithi197.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = False 2021-07-26T15:35:25.498 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-07-26T15:35:25.498 INFO:teuthology.orchestra.run.smithi197.stdout:[client] 2021-07-26T15:35:25.498 INFO:teuthology.orchestra.run.smithi197.stdout: rgw cache enabled = true 2021-07-26T15:35:25.499 INFO:teuthology.orchestra.run.smithi197.stdout: rgw enable ops log = true 2021-07-26T15:35:25.499 INFO:teuthology.orchestra.run.smithi197.stdout: rgw enable usage log = true 2021-07-26T15:35:25.499 INFO:teuthology.orchestra.run.smithi197.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-07-26T15:35:25.499 INFO:teuthology.orchestra.run.smithi197.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-07-26T15:35:25.499 INFO:teuthology.orchestra.run.smithi197.stdout: debug rgw = 20 2021-07-26T15:35:25.500 INFO:teuthology.orchestra.run.smithi197.stdout: rgw crypt require ssl = False 2021-07-26T15:35:25.500 INFO:teuthology.orchestra.run.smithi197.stdout: rgw crypt s3 kms backend = testing 2021-07-26T15:35:25.500 INFO:teuthology.orchestra.run.smithi197.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2021-07-26T15:35:25.500 INFO:teuthology.orchestra.run.smithi197.stdout: rgw curl low speed time = 300 2021-07-26T15:35:25.501 INFO:teuthology.orchestra.run.smithi197.stdout: rgw data log num shards = 4 2021-07-26T15:35:25.501 INFO:teuthology.orchestra.run.smithi197.stdout: rgw md log max shards = 4 2021-07-26T15:35:25.501 INFO:teuthology.orchestra.run.smithi197.stdout: rgw sync log trim interval = 0 2021-07-26T15:35:25.501 INFO:teuthology.orchestra.run.smithi197.stdout: rgw sync obj etag verify = True 2021-07-26T15:35:25.501 INFO:teuthology.orchestra.run.smithi197.stdout: setgroup = ceph 2021-07-26T15:35:25.502 INFO:teuthology.orchestra.run.smithi197.stdout: setuser = ceph 2021-07-26T15:35:25.502 INFO:teuthology.orchestra.run.smithi197.stdout:[mon.a] 2021-07-26T15:35:25.502 INFO:tasks.ceph:Creating admin key on c1.mon.a... 2021-07-26T15:35:25.503 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/c1.keyring 2021-07-26T15:35:25.550 INFO:tasks.ceph:Copying monmap to all nodes... 2021-07-26T15:35:25.550 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2021-07-26T15:35:25.551 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/etc/ceph/c1.keyring of=/dev/stdout 2021-07-26T15:35:25.559 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2021-07-26T15:35:25.559 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/home/ubuntu/cephtest/c1.monmap of=/dev/stdout 2021-07-26T15:35:25.565 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi183.front.sepia.ceph.com 2021-07-26T15:35:25.566 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2021-07-26T15:35:25.566 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/etc/ceph/c1.keyring 2021-07-26T15:35:25.566 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 0644 /etc/ceph/c1.keyring 2021-07-26T15:35:25.589 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2021-07-26T15:35:25.590 DEBUG:teuthology.orchestra.run.smithi183:> dd of=/home/ubuntu/cephtest/c1.monmap 2021-07-26T15:35:25.638 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi197.front.sepia.ceph.com 2021-07-26T15:35:25.638 DEBUG:teuthology.orchestra.run.smithi197:> set -ex 2021-07-26T15:35:25.639 DEBUG:teuthology.orchestra.run.smithi197:> sudo dd of=/etc/ceph/c1.keyring 2021-07-26T15:35:25.639 DEBUG:teuthology.orchestra.run.smithi197:> sudo chmod 0644 /etc/ceph/c1.keyring 2021-07-26T15:35:25.666 DEBUG:teuthology.orchestra.run.smithi197:> set -ex 2021-07-26T15:35:25.667 DEBUG:teuthology.orchestra.run.smithi197:> dd of=/home/ubuntu/cephtest/c1.monmap 2021-07-26T15:35:25.672 INFO:tasks.ceph:Setting up mon nodes... 2021-07-26T15:35:25.672 INFO:tasks.ceph:Setting up mgr nodes... 2021-07-26T15:35:25.673 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/mgr/c1-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/c1-x/keyring 2021-07-26T15:35:25.715 INFO:teuthology.orchestra.run.smithi183.stdout:creating /var/lib/ceph/mgr/c1-x/keyring 2021-07-26T15:35:25.718 INFO:tasks.ceph:Setting up mds nodes... 2021-07-26T15:35:25.719 INFO:tasks.ceph_client:Setting up client nodes... 2021-07-26T15:35:25.720 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/c1.client.0.keyring && sudo chmod 0644 /etc/ceph/c1.client.0.keyring 2021-07-26T15:35:25.751 INFO:teuthology.orchestra.run.smithi183.stdout:creating /etc/ceph/c1.client.0.keyring 2021-07-26T15:35:25.764 INFO:tasks.ceph:Running mkfs on osd nodes... 2021-07-26T15:35:25.766 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi183.front.sepia.ceph.com'): {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'}} 2021-07-26T15:35:25.767 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/osd/c1-0 2021-07-26T15:35:25.823 INFO:tasks.ceph:roles_to_devs: {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'} 2021-07-26T15:35:25.823 INFO:tasks.ceph:role: c1.osd.0 2021-07-26T15:35:25.824 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi183.front.sepia.ceph.com 2021-07-26T15:35:25.824 DEBUG:teuthology.orchestra.run.smithi183:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2021-07-26T15:35:26.360 INFO:teuthology.orchestra.run.smithi183.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2021-07-26T15:35:26.361 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 attr=2, projid32bit=1 2021-07-26T15:35:26.361 INFO:teuthology.orchestra.run.smithi183.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-07-26T15:35:26.361 INFO:teuthology.orchestra.run.smithi183.stdout: = reflink=1 2021-07-26T15:35:26.361 INFO:teuthology.orchestra.run.smithi183.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-07-26T15:35:26.362 INFO:teuthology.orchestra.run.smithi183.stdout: = sunit=0 swidth=0 blks 2021-07-26T15:35:26.362 INFO:teuthology.orchestra.run.smithi183.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-07-26T15:35:26.362 INFO:teuthology.orchestra.run.smithi183.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-07-26T15:35:26.362 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-07-26T15:35:26.363 INFO:teuthology.orchestra.run.smithi183.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-07-26T15:35:26.364 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi183.front.sepia.ceph.com -o noatime 2021-07-26T15:35:26.364 DEBUG:teuthology.orchestra.run.smithi183:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/c1-0 2021-07-26T15:35:26.451 DEBUG:teuthology.orchestra.run.smithi183:> sudo /sbin/restorecon /var/lib/ceph/osd/c1-0 2021-07-26T15:35:26.464 INFO:teuthology.orchestra.run.smithi183.stderr:sudo: /sbin/restorecon: command not found 2021-07-26T15:35:26.464 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-07-26T15:35:26.465 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/osd/c1-1 2021-07-26T15:35:26.475 INFO:tasks.ceph:roles_to_devs: {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'} 2021-07-26T15:35:26.475 INFO:tasks.ceph:role: c1.osd.1 2021-07-26T15:35:26.475 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi183.front.sepia.ceph.com 2021-07-26T15:35:26.476 DEBUG:teuthology.orchestra.run.smithi183:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2021-07-26T15:35:27.004 INFO:teuthology.orchestra.run.smithi183.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2021-07-26T15:35:27.005 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 attr=2, projid32bit=1 2021-07-26T15:35:27.005 INFO:teuthology.orchestra.run.smithi183.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-07-26T15:35:27.006 INFO:teuthology.orchestra.run.smithi183.stdout: = reflink=1 2021-07-26T15:35:27.006 INFO:teuthology.orchestra.run.smithi183.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-07-26T15:35:27.006 INFO:teuthology.orchestra.run.smithi183.stdout: = sunit=0 swidth=0 blks 2021-07-26T15:35:27.006 INFO:teuthology.orchestra.run.smithi183.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-07-26T15:35:27.007 INFO:teuthology.orchestra.run.smithi183.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-07-26T15:35:27.007 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-07-26T15:35:27.007 INFO:teuthology.orchestra.run.smithi183.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-07-26T15:35:27.009 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi183.front.sepia.ceph.com -o noatime 2021-07-26T15:35:27.009 DEBUG:teuthology.orchestra.run.smithi183:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/c1-1 2021-07-26T15:35:27.053 DEBUG:teuthology.orchestra.run.smithi183:> sudo /sbin/restorecon /var/lib/ceph/osd/c1-1 2021-07-26T15:35:27.066 INFO:teuthology.orchestra.run.smithi183.stderr:sudo: /sbin/restorecon: command not found 2021-07-26T15:35:27.067 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-07-26T15:35:27.067 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/osd/c1-2 2021-07-26T15:35:27.126 INFO:tasks.ceph:roles_to_devs: {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'} 2021-07-26T15:35:27.126 INFO:tasks.ceph:role: c1.osd.2 2021-07-26T15:35:27.127 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi183.front.sepia.ceph.com 2021-07-26T15:35:27.127 DEBUG:teuthology.orchestra.run.smithi183:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2021-07-26T15:35:27.603 INFO:teuthology.orchestra.run.smithi183.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2021-07-26T15:35:27.603 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 attr=2, projid32bit=1 2021-07-26T15:35:27.603 INFO:teuthology.orchestra.run.smithi183.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-07-26T15:35:27.603 INFO:teuthology.orchestra.run.smithi183.stdout: = reflink=1 2021-07-26T15:35:27.604 INFO:teuthology.orchestra.run.smithi183.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-07-26T15:35:27.604 INFO:teuthology.orchestra.run.smithi183.stdout: = sunit=0 swidth=0 blks 2021-07-26T15:35:27.604 INFO:teuthology.orchestra.run.smithi183.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-07-26T15:35:27.604 INFO:teuthology.orchestra.run.smithi183.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-07-26T15:35:27.605 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-07-26T15:35:27.605 INFO:teuthology.orchestra.run.smithi183.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-07-26T15:35:27.606 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi183.front.sepia.ceph.com -o noatime 2021-07-26T15:35:27.607 DEBUG:teuthology.orchestra.run.smithi183:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/c1-2 2021-07-26T15:35:27.660 DEBUG:teuthology.orchestra.run.smithi183:> sudo /sbin/restorecon /var/lib/ceph/osd/c1-2 2021-07-26T15:35:27.672 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-07-26T15:35:27.673 INFO:teuthology.orchestra.run.smithi183.stderr:sudo: /sbin/restorecon: command not found 2021-07-26T15:35:27.673 DEBUG:teuthology.orchestra.run.smithi183:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c1 --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/c1.monmap 2021-07-26T15:35:27.736 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:35:27.741+0000 7f4fa2668d80 -1 auth: error reading file: /var/lib/ceph/osd/c1-0/keyring: can't open /var/lib/ceph/osd/c1-0/keyring: (2) No such file or directory 2021-07-26T15:35:27.737 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:35:27.741+0000 7f4fa2668d80 -1 created new key in keyring /var/lib/ceph/osd/c1-0/keyring 2021-07-26T15:35:27.737 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:35:27.741+0000 7f4fa2668d80 -1 bluestore(/var/lib/ceph/osd/c1-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-0/block: (2) No such file or directory 2021-07-26T15:35:27.737 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:35:27.741+0000 7f4fa2668d80 -1 bluestore(/var/lib/ceph/osd/c1-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-0/block: (2) No such file or directory 2021-07-26T15:35:27.738 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:35:27.741+0000 7f4fa2668d80 -1 bluestore(/var/lib/ceph/osd/c1-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-0/block: (2) No such file or directory 2021-07-26T15:35:27.739 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:35:27.745+0000 7f4fa2668d80 -1 bluestore(/var/lib/ceph/osd/c1-0) _read_fsid unparsable uuid 2021-07-26T15:35:27.765 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:35:27.769+0000 7f4fa2668d80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-07-26T15:35:29.658 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c1-0 2021-07-26T15:35:29.674 DEBUG:teuthology.orchestra.run.smithi183:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c1 --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/c1.monmap 2021-07-26T15:35:29.709 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:35:29.713+0000 7f9814f34d80 -1 auth: error reading file: /var/lib/ceph/osd/c1-1/keyring: can't open /var/lib/ceph/osd/c1-1/keyring: (2) No such file or directory 2021-07-26T15:35:29.710 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:35:29.713+0000 7f9814f34d80 -1 created new key in keyring /var/lib/ceph/osd/c1-1/keyring 2021-07-26T15:35:29.710 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:35:29.713+0000 7f9814f34d80 -1 bluestore(/var/lib/ceph/osd/c1-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-1/block: (2) No such file or directory 2021-07-26T15:35:29.710 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:35:29.713+0000 7f9814f34d80 -1 bluestore(/var/lib/ceph/osd/c1-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-1/block: (2) No such file or directory 2021-07-26T15:35:29.711 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:35:29.713+0000 7f9814f34d80 -1 bluestore(/var/lib/ceph/osd/c1-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-1/block: (2) No such file or directory 2021-07-26T15:35:29.711 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:35:29.713+0000 7f9814f34d80 -1 bluestore(/var/lib/ceph/osd/c1-1) _read_fsid unparsable uuid 2021-07-26T15:35:29.730 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:35:29.733+0000 7f9814f34d80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-07-26T15:35:31.637 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c1-1 2021-07-26T15:35:31.653 DEBUG:teuthology.orchestra.run.smithi183:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c1 --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/c1.monmap 2021-07-26T15:35:31.735 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:35:31.737+0000 7f2144b3dd80 -1 auth: error reading file: /var/lib/ceph/osd/c1-2/keyring: can't open /var/lib/ceph/osd/c1-2/keyring: (2) No such file or directory 2021-07-26T15:35:31.736 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:35:31.737+0000 7f2144b3dd80 -1 created new key in keyring /var/lib/ceph/osd/c1-2/keyring 2021-07-26T15:35:31.736 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:35:31.737+0000 7f2144b3dd80 -1 bluestore(/var/lib/ceph/osd/c1-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-2/block: (2) No such file or directory 2021-07-26T15:35:31.736 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:35:31.737+0000 7f2144b3dd80 -1 bluestore(/var/lib/ceph/osd/c1-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-2/block: (2) No such file or directory 2021-07-26T15:35:31.737 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:35:31.737+0000 7f2144b3dd80 -1 bluestore(/var/lib/ceph/osd/c1-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-2/block: (2) No such file or directory 2021-07-26T15:35:31.737 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:35:31.741+0000 7f2144b3dd80 -1 bluestore(/var/lib/ceph/osd/c1-2) _read_fsid unparsable uuid 2021-07-26T15:35:31.750 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:35:31.753+0000 7f2144b3dd80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-07-26T15:35:33.664 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c1-2 2021-07-26T15:35:33.677 INFO:tasks.ceph:Reading keys from all nodes... 2021-07-26T15:35:33.678 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2021-07-26T15:35:33.678 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/mgr/c1-x/keyring of=/dev/stdout 2021-07-26T15:35:33.689 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2021-07-26T15:35:33.690 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/c1-0/keyring of=/dev/stdout 2021-07-26T15:35:33.703 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2021-07-26T15:35:33.703 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/c1-1/keyring of=/dev/stdout 2021-07-26T15:35:33.765 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2021-07-26T15:35:33.766 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/c1-2/keyring of=/dev/stdout 2021-07-26T15:35:33.777 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2021-07-26T15:35:33.778 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/etc/ceph/c1.client.0.keyring of=/dev/stdout 2021-07-26T15:35:33.783 INFO:tasks.ceph:Adding keys to all mons... 2021-07-26T15:35:33.784 DEBUG:teuthology.orchestra.run.smithi183:> sudo tee -a /etc/ceph/c1.keyring 2021-07-26T15:35:33.840 INFO:teuthology.orchestra.run.smithi183.stdout:[mgr.x] 2021-07-26T15:35:33.841 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQA91v5ggFArKxAAR1PEc78l7C/7t7602r+6xA== 2021-07-26T15:35:33.841 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.0] 2021-07-26T15:35:33.841 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQA/1v5griVxLBAANDpdehRAycihjP6N7IuSjw== 2021-07-26T15:35:33.841 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.1] 2021-07-26T15:35:33.841 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQBB1v5gg+zVKhAAzQRPetfdGlaGGuge5Qy6ew== 2021-07-26T15:35:33.842 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.2] 2021-07-26T15:35:33.842 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQBD1v5gZi5ULBAApidRM0kyokLOuVrmhzMoaQ== 2021-07-26T15:35:33.842 INFO:teuthology.orchestra.run.smithi183.stdout:[client.0] 2021-07-26T15:35:33.843 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQA91v5gfQdaLRAAvKWzXFVt+l1t7b5rld0dgQ== 2021-07-26T15:35:33.844 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-07-26T15:35:33.882 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-07-26T15:35:33.920 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-07-26T15:35:34.005 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-07-26T15:35:34.042 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-07-26T15:35:34.083 INFO:tasks.ceph:Running mkfs on mon nodes... 2021-07-26T15:35:34.084 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/mon/c1-a 2021-07-26T15:35:34.142 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster c1 --mkfs -i a --monmap /home/ubuntu/cephtest/c1.monmap --keyring /etc/ceph/c1.keyring 2021-07-26T15:35:34.194 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/mon/c1-a 2021-07-26T15:35:34.208 DEBUG:teuthology.orchestra.run.smithi183:> rm -- /home/ubuntu/cephtest/c1.monmap 2021-07-26T15:35:34.256 INFO:tasks.ceph:Starting mon daemons in cluster c1... 2021-07-26T15:35:34.257 INFO:tasks.ceph.c1.mon.a:Restarting daemon 2021-07-26T15:35:34.258 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster c1 -i a 2021-07-26T15:35:34.261 INFO:tasks.ceph.c1.mon.a:Started 2021-07-26T15:35:34.261 INFO:tasks.ceph:Starting mgr daemons in cluster c1... 2021-07-26T15:35:34.261 INFO:tasks.ceph.c1.mgr.x:Restarting daemon 2021-07-26T15:35:34.262 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster c1 -i x 2021-07-26T15:35:34.264 INFO:tasks.ceph.c1.mgr.x:Started 2021-07-26T15:35:34.265 INFO:tasks.ceph:Setting crush tunables to default 2021-07-26T15:35:34.265 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster c1 osd crush tunables default 2021-07-26T15:35:34.487 INFO:teuthology.orchestra.run.smithi183.stderr:adjusted tunables profile to default 2021-07-26T15:35:34.500 INFO:tasks.ceph:Starting osd daemons in cluster c1... 2021-07-26T15:35:34.500 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2021-07-26T15:35:34.501 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/c1-0/fsid of=/dev/stdout 2021-07-26T15:35:34.516 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2021-07-26T15:35:34.516 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/c1-1/fsid of=/dev/stdout 2021-07-26T15:35:34.527 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2021-07-26T15:35:34.528 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/c1-2/fsid of=/dev/stdout 2021-07-26T15:35:34.540 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster c1 osd new be06d369-3500-477a-858a-a2ecd3b96513 0 2021-07-26T15:35:34.718 INFO:teuthology.orchestra.run.smithi183.stdout:0 2021-07-26T15:35:34.735 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster c1 osd new 281f6d0c-5db7-4401-b4bf-98adf1b66276 1 2021-07-26T15:35:34.919 INFO:teuthology.orchestra.run.smithi183.stdout:1 2021-07-26T15:35:34.931 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster c1 osd new c0c92f2f-f5a4-4af8-8e06-ca4657762e5d 2 2021-07-26T15:35:35.116 INFO:teuthology.orchestra.run.smithi183.stdout:2 2021-07-26T15:35:35.129 INFO:tasks.ceph.c1.osd.0:Restarting daemon 2021-07-26T15:35:35.130 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c1 -i 0 2021-07-26T15:35:35.132 INFO:tasks.ceph.c1.osd.0:Started 2021-07-26T15:35:35.133 INFO:tasks.ceph.c1.osd.1:Restarting daemon 2021-07-26T15:35:35.133 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c1 -i 1 2021-07-26T15:35:35.136 INFO:tasks.ceph.c1.osd.1:Started 2021-07-26T15:35:35.136 INFO:tasks.ceph.c1.osd.2:Restarting daemon 2021-07-26T15:35:35.138 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c1 -i 2 2021-07-26T15:35:35.143 INFO:tasks.ceph.c1.osd.2:Started 2021-07-26T15:35:35.144 INFO:tasks.ceph:Waiting for OSDs to come up 2021-07-26T15:35:35.448 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster c1 osd dump --format=json 2021-07-26T15:35:35.500 INFO:tasks.ceph.c1.osd.2.smithi183.stderr:2021-07-26T15:35:35.505+0000 7f3aff8fdd80 -1 Falling back to public interface 2021-07-26T15:35:35.603 INFO:teuthology.misc.health.smithi183.stdout: 2021-07-26T15:35:35.604 INFO:teuthology.misc.health.smithi183.stdout:{"epoch":5,"fsid":"8e1b7cac-42bd-407f-81ac-24faa0e6ffe5","created":"2021-07-26T15:35:34.383765+0000","modified":"2021-07-26T15:35:35.122484+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"be06d369-3500-477a-858a-a2ecd3b96513","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"281f6d0c-5db7-4401-b4bf-98adf1b66276","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c0c92f2f-f5a4-4af8-8e06-ca4657762e5d","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-07-26T15:35:35.615 DEBUG:teuthology.misc:0 of 3 OSDs are up 2021-07-26T15:35:35.745 INFO:tasks.ceph.c1.osd.0.smithi183.stderr:2021-07-26T15:35:35.749+0000 7f26ac69dd80 -1 Falling back to public interface 2021-07-26T15:35:35.776 INFO:tasks.ceph.c1.osd.1.smithi183.stderr:2021-07-26T15:35:35.781+0000 7f069fb27d80 -1 Falling back to public interface 2021-07-26T15:35:36.126 INFO:tasks.ceph.c1.osd.2.smithi183.stderr:2021-07-26T15:35:36.129+0000 7f3aff8fdd80 -1 osd.2 0 log_to_monitors {default=true} 2021-07-26T15:35:36.379 INFO:tasks.ceph.c1.osd.0.smithi183.stderr:2021-07-26T15:35:36.381+0000 7f26ac69dd80 -1 osd.0 0 log_to_monitors {default=true} 2021-07-26T15:35:36.392 INFO:tasks.ceph.c1.osd.1.smithi183.stderr:2021-07-26T15:35:36.397+0000 7f069fb27d80 -1 osd.1 0 log_to_monitors {default=true} 2021-07-26T15:35:37.409 INFO:tasks.ceph.c1.osd.0.smithi183.stderr:2021-07-26T15:35:37.413+0000 7f269e757700 -1 osd.0 0 waiting for initial osdmap 2021-07-26T15:35:37.409 INFO:tasks.ceph.c1.osd.2.smithi183.stderr:2021-07-26T15:35:37.413+0000 7f3af19b7700 -1 osd.2 0 waiting for initial osdmap 2021-07-26T15:35:38.406 INFO:tasks.ceph.c1.osd.1.smithi183.stderr:2021-07-26T15:35:38.409+0000 7f0691be1700 -1 osd.1 0 waiting for initial osdmap 2021-07-26T15:35:41.920 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster c1 osd dump --format=json 2021-07-26T15:35:42.159 INFO:teuthology.misc.health.smithi183.stdout: 2021-07-26T15:35:42.160 INFO:teuthology.misc.health.smithi183.stdout:{"epoch":11,"fsid":"8e1b7cac-42bd-407f-81ac-24faa0e6ffe5","created":"2021-07-26T15:35:34.383765+0000","modified":"2021-07-26T15:35:41.431949+0000","last_up_change":"2021-07-26T15:35:39.417102+0000","last_in_change":"2021-07-26T15:35:39.417102+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-07-26T15:35:37.327166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"be06d369-3500-477a-858a-a2ecd3b96513","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":8,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":14244},{"type":"v1","addr":"172.21.15.183:6809","nonce":14244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":14244},{"type":"v1","addr":"172.21.15.183:6811","nonce":14244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":14244},{"type":"v1","addr":"172.21.15.183:6815","nonce":14244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":14244},{"type":"v1","addr":"172.21.15.183:6813","nonce":14244}]},"public_addr":"172.21.15.183:6809/14244","cluster_addr":"172.21.15.183:6811/14244","heartbeat_back_addr":"172.21.15.183:6815/14244","heartbeat_front_addr":"172.21.15.183:6813/14244","state":["exists","up"]},{"osd":1,"uuid":"281f6d0c-5db7-4401-b4bf-98adf1b66276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":14245},{"type":"v1","addr":"172.21.15.183:6817","nonce":14245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":14245},{"type":"v1","addr":"172.21.15.183:6819","nonce":14245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":14245},{"type":"v1","addr":"172.21.15.183:6823","nonce":14245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":14245},{"type":"v1","addr":"172.21.15.183:6821","nonce":14245}]},"public_addr":"172.21.15.183:6817/14245","cluster_addr":"172.21.15.183:6819/14245","heartbeat_back_addr":"172.21.15.183:6823/14245","heartbeat_front_addr":"172.21.15.183:6821/14245","state":["exists","up"]},{"osd":2,"uuid":"c0c92f2f-f5a4-4af8-8e06-ca4657762e5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":14246},{"type":"v1","addr":"172.21.15.183:6801","nonce":14246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":14246},{"type":"v1","addr":"172.21.15.183:6803","nonce":14246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":14246},{"type":"v1","addr":"172.21.15.183:6807","nonce":14246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":14246},{"type":"v1","addr":"172.21.15.183:6805","nonce":14246}]},"public_addr":"172.21.15.183:6801/14246","cluster_addr":"172.21.15.183:6803/14246","heartbeat_back_addr":"172.21.15.183:6807/14246","heartbeat_front_addr":"172.21.15.183:6805/14246","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:35:37.396759+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:35:37.441001+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:35:37.140822+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-07-26T15:35:42.171 DEBUG:teuthology.misc:3 of 3 OSDs are up 2021-07-26T15:35:42.171 INFO:tasks.ceph:Creating RBD pool 2021-07-26T15:35:42.172 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster c1 osd pool create rbd 8 2021-07-26T15:35:42.806 INFO:teuthology.orchestra.run.smithi183.stderr:pool 'rbd' created 2021-07-26T15:35:42.818 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster c1 osd pool application enable rbd rbd --yes-i-really-mean-it 2021-07-26T15:35:43.816 INFO:teuthology.orchestra.run.smithi183.stderr:enabled application 'rbd' on pool 'rbd' 2021-07-26T15:35:43.825 INFO:tasks.ceph:Starting mds daemons in cluster c1... 2021-07-26T15:35:43.827 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd dump --format=json 2021-07-26T15:35:43.827 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2021-07-26T15:35:44.059 INFO:teuthology.orchestra.run.smithi183.stdout: 2021-07-26T15:35:44.059 INFO:teuthology.orchestra.run.smithi183.stdout:{"epoch":13,"fsid":"8e1b7cac-42bd-407f-81ac-24faa0e6ffe5","created":"2021-07-26T15:35:34.383765+0000","modified":"2021-07-26T15:35:43.804697+0000","last_up_change":"2021-07-26T15:35:39.417102+0000","last_in_change":"2021-07-26T15:35:39.417102+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-07-26T15:35:37.327166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-07-26T15:35:42.487877+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"be06d369-3500-477a-858a-a2ecd3b96513","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":14244},{"type":"v1","addr":"172.21.15.183:6809","nonce":14244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":14244},{"type":"v1","addr":"172.21.15.183:6811","nonce":14244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":14244},{"type":"v1","addr":"172.21.15.183:6815","nonce":14244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":14244},{"type":"v1","addr":"172.21.15.183:6813","nonce":14244}]},"public_addr":"172.21.15.183:6809/14244","cluster_addr":"172.21.15.183:6811/14244","heartbeat_back_addr":"172.21.15.183:6815/14244","heartbeat_front_addr":"172.21.15.183:6813/14244","state":["exists","up"]},{"osd":1,"uuid":"281f6d0c-5db7-4401-b4bf-98adf1b66276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":14245},{"type":"v1","addr":"172.21.15.183:6817","nonce":14245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":14245},{"type":"v1","addr":"172.21.15.183:6819","nonce":14245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":14245},{"type":"v1","addr":"172.21.15.183:6823","nonce":14245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":14245},{"type":"v1","addr":"172.21.15.183:6821","nonce":14245}]},"public_addr":"172.21.15.183:6817/14245","cluster_addr":"172.21.15.183:6819/14245","heartbeat_back_addr":"172.21.15.183:6823/14245","heartbeat_front_addr":"172.21.15.183:6821/14245","state":["exists","up"]},{"osd":2,"uuid":"c0c92f2f-f5a4-4af8-8e06-ca4657762e5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":14246},{"type":"v1","addr":"172.21.15.183:6801","nonce":14246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":14246},{"type":"v1","addr":"172.21.15.183:6803","nonce":14246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":14246},{"type":"v1","addr":"172.21.15.183:6807","nonce":14246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":14246},{"type":"v1","addr":"172.21.15.183:6805","nonce":14246}]},"public_addr":"172.21.15.183:6801/14246","cluster_addr":"172.21.15.183:6803/14246","heartbeat_back_addr":"172.21.15.183:6807/14246","heartbeat_front_addr":"172.21.15.183:6805/14246","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:35:37.396759+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:35:37.441001+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:35:37.140822+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-07-26T15:35:44.072 INFO:tasks.ceph.ceph_manager.c1:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-07-26T15:35:37.327166+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-07-26T15:35:42.487877+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-07-26T15:35:44.077 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd pool get device_health_metrics pg_num 2021-07-26T15:35:44.323 INFO:teuthology.orchestra.run.smithi183.stdout:pg_num: 1 2021-07-26T15:35:44.335 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd pool get rbd pg_num 2021-07-26T15:35:44.587 INFO:teuthology.orchestra.run.smithi183.stdout:pg_num: 8 2021-07-26T15:35:44.605 INFO:tasks.ceph:Waiting until c1 daemons up and pgs clean... 2021-07-26T15:35:44.606 INFO:tasks.ceph.ceph_manager.c1:waiting for mgr available 2021-07-26T15:35:44.606 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 mgr dump --format=json 2021-07-26T15:35:44.873 INFO:teuthology.orchestra.run.smithi183.stdout: 2021-07-26T15:35:44.885 INFO:teuthology.orchestra.run.smithi183.stdout:{"epoch":4,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":14058},{"type":"v1","addr":"172.21.15.183:6825","nonce":14058}]},"active_addr":"172.21.15.183:6825/14058","active_change":"2021-07-26T15:35:37.245990+0000","active_mgr_features":4540138292840890367,"available":true,"standbys":[],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.183:0","nonce":2156289138}]},{"addrvec":[{"type":"v2","addr":"172.21.15.183:0","nonce":339183628}]},{"addrvec":[{"type":"v2","addr":"172.21.15.183:0","nonce":2175611014}]}]}} 2021-07-26T15:35:44.887 INFO:tasks.ceph.ceph_manager.c1:mgr available! 2021-07-26T15:35:44.888 INFO:tasks.ceph.ceph_manager.c1:waiting for all up 2021-07-26T15:35:44.888 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd dump --format=json 2021-07-26T15:35:45.131 INFO:teuthology.orchestra.run.smithi183.stdout: 2021-07-26T15:35:45.132 INFO:teuthology.orchestra.run.smithi183.stdout:{"epoch":14,"fsid":"8e1b7cac-42bd-407f-81ac-24faa0e6ffe5","created":"2021-07-26T15:35:34.383765+0000","modified":"2021-07-26T15:35:44.809726+0000","last_up_change":"2021-07-26T15:35:39.417102+0000","last_in_change":"2021-07-26T15:35:39.417102+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-07-26T15:35:37.327166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-07-26T15:35:42.487877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"be06d369-3500-477a-858a-a2ecd3b96513","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":14244},{"type":"v1","addr":"172.21.15.183:6809","nonce":14244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":14244},{"type":"v1","addr":"172.21.15.183:6811","nonce":14244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":14244},{"type":"v1","addr":"172.21.15.183:6815","nonce":14244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":14244},{"type":"v1","addr":"172.21.15.183:6813","nonce":14244}]},"public_addr":"172.21.15.183:6809/14244","cluster_addr":"172.21.15.183:6811/14244","heartbeat_back_addr":"172.21.15.183:6815/14244","heartbeat_front_addr":"172.21.15.183:6813/14244","state":["exists","up"]},{"osd":1,"uuid":"281f6d0c-5db7-4401-b4bf-98adf1b66276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":14245},{"type":"v1","addr":"172.21.15.183:6817","nonce":14245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":14245},{"type":"v1","addr":"172.21.15.183:6819","nonce":14245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":14245},{"type":"v1","addr":"172.21.15.183:6823","nonce":14245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":14245},{"type":"v1","addr":"172.21.15.183:6821","nonce":14245}]},"public_addr":"172.21.15.183:6817/14245","cluster_addr":"172.21.15.183:6819/14245","heartbeat_back_addr":"172.21.15.183:6823/14245","heartbeat_front_addr":"172.21.15.183:6821/14245","state":["exists","up"]},{"osd":2,"uuid":"c0c92f2f-f5a4-4af8-8e06-ca4657762e5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":14246},{"type":"v1","addr":"172.21.15.183:6801","nonce":14246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":14246},{"type":"v1","addr":"172.21.15.183:6803","nonce":14246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":14246},{"type":"v1","addr":"172.21.15.183:6807","nonce":14246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":14246},{"type":"v1","addr":"172.21.15.183:6805","nonce":14246}]},"public_addr":"172.21.15.183:6801/14246","cluster_addr":"172.21.15.183:6803/14246","heartbeat_back_addr":"172.21.15.183:6807/14246","heartbeat_front_addr":"172.21.15.183:6805/14246","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:35:37.396759+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:35:37.441001+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:35:37.140822+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-07-26T15:35:45.143 INFO:tasks.ceph.ceph_manager.c1:all up! 2021-07-26T15:35:45.144 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd dump --format=json 2021-07-26T15:35:45.393 INFO:teuthology.orchestra.run.smithi183.stdout: 2021-07-26T15:35:45.393 INFO:teuthology.orchestra.run.smithi183.stdout:{"epoch":14,"fsid":"8e1b7cac-42bd-407f-81ac-24faa0e6ffe5","created":"2021-07-26T15:35:34.383765+0000","modified":"2021-07-26T15:35:44.809726+0000","last_up_change":"2021-07-26T15:35:39.417102+0000","last_in_change":"2021-07-26T15:35:39.417102+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-07-26T15:35:37.327166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-07-26T15:35:42.487877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"be06d369-3500-477a-858a-a2ecd3b96513","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":14244},{"type":"v1","addr":"172.21.15.183:6809","nonce":14244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":14244},{"type":"v1","addr":"172.21.15.183:6811","nonce":14244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":14244},{"type":"v1","addr":"172.21.15.183:6815","nonce":14244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":14244},{"type":"v1","addr":"172.21.15.183:6813","nonce":14244}]},"public_addr":"172.21.15.183:6809/14244","cluster_addr":"172.21.15.183:6811/14244","heartbeat_back_addr":"172.21.15.183:6815/14244","heartbeat_front_addr":"172.21.15.183:6813/14244","state":["exists","up"]},{"osd":1,"uuid":"281f6d0c-5db7-4401-b4bf-98adf1b66276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":14245},{"type":"v1","addr":"172.21.15.183:6817","nonce":14245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":14245},{"type":"v1","addr":"172.21.15.183:6819","nonce":14245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":14245},{"type":"v1","addr":"172.21.15.183:6823","nonce":14245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":14245},{"type":"v1","addr":"172.21.15.183:6821","nonce":14245}]},"public_addr":"172.21.15.183:6817/14245","cluster_addr":"172.21.15.183:6819/14245","heartbeat_back_addr":"172.21.15.183:6823/14245","heartbeat_front_addr":"172.21.15.183:6821/14245","state":["exists","up"]},{"osd":2,"uuid":"c0c92f2f-f5a4-4af8-8e06-ca4657762e5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":14246},{"type":"v1","addr":"172.21.15.183:6801","nonce":14246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":14246},{"type":"v1","addr":"172.21.15.183:6803","nonce":14246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":14246},{"type":"v1","addr":"172.21.15.183:6807","nonce":14246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":14246},{"type":"v1","addr":"172.21.15.183:6805","nonce":14246}]},"public_addr":"172.21.15.183:6801/14246","cluster_addr":"172.21.15.183:6803/14246","heartbeat_back_addr":"172.21.15.183:6807/14246","heartbeat_front_addr":"172.21.15.183:6805/14246","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:35:37.396759+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:35:37.441001+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:35:37.140822+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-07-26T15:35:45.412 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 tell osd.0 flush_pg_stats 2021-07-26T15:35:45.549 INFO:teuthology.orchestra.run.smithi183.stdout:34359738372 2021-07-26T15:35:45.550 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 tell osd.1 flush_pg_stats 2021-07-26T15:35:45.696 INFO:teuthology.orchestra.run.smithi183.stdout:38654705668 2021-07-26T15:35:45.697 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 tell osd.2 flush_pg_stats 2021-07-26T15:35:45.836 INFO:teuthology.orchestra.run.smithi183.stdout:34359738372 2021-07-26T15:35:45.837 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.0 2021-07-26T15:35:46.077 INFO:teuthology.orchestra.run.smithi183.stdout:34359738371 2021-07-26T15:35:46.089 INFO:tasks.ceph.ceph_manager.c1:need seq 34359738372 got 34359738371 for osd.0 2021-07-26T15:35:47.094 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.0 2021-07-26T15:35:47.364 INFO:teuthology.orchestra.run.smithi183.stdout:34359738371 2021-07-26T15:35:47.376 INFO:tasks.ceph.ceph_manager.c1:need seq 34359738372 got 34359738371 for osd.0 2021-07-26T15:35:48.378 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.0 2021-07-26T15:35:48.631 INFO:teuthology.orchestra.run.smithi183.stdout:34359738372 2021-07-26T15:35:48.644 INFO:tasks.ceph.ceph_manager.c1:need seq 34359738372 got 34359738372 for osd.0 2021-07-26T15:35:48.644 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.1 2021-07-26T15:35:48.881 INFO:teuthology.orchestra.run.smithi183.stdout:38654705668 2021-07-26T15:35:48.900 INFO:tasks.ceph.ceph_manager.c1:need seq 38654705668 got 38654705668 for osd.1 2021-07-26T15:35:48.901 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.2 2021-07-26T15:35:49.137 INFO:teuthology.orchestra.run.smithi183.stdout:34359738372 2021-07-26T15:35:49.150 INFO:tasks.ceph.ceph_manager.c1:need seq 34359738372 got 34359738372 for osd.2 2021-07-26T15:35:49.150 INFO:tasks.ceph.ceph_manager.c1:waiting for clean 2021-07-26T15:35:49.151 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 pg dump --format=json 2021-07-26T15:35:49.381 INFO:teuthology.orchestra.run.smithi183.stdout: 2021-07-26T15:35:49.384 INFO:teuthology.orchestra.run.smithi183.stderr:dumped all 2021-07-26T15:35:49.396 INFO:teuthology.orchestra.run.smithi183.stdout:{"pg_ready":true,"pg_map":{"version":16,"stamp":"2021-07-26T15:35:49.257000+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":11,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":3146104,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":3145728,"kb_avail":311426696,"statfs":{"total":322122547200,"available":318900936704,"internally_reserved":3221225472,"allocated":360448,"data_stored":103800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3221225472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000522"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-07-26T15:35:43.823606+0000","last_change":"2021-07-26T15:35:43.820724+0000","last_active":"2021-07-26T15:35:43.823606+0000","last_peered":"2021-07-26T15:35:43.823606+0000","last_clean":"2021-07-26T15:35:43.823606+0000","last_became_active":"2021-07-26T15:35:43.819753+0000","last_became_peered":"2021-07-26T15:35:43.819753+0000","last_unstale":"2021-07-26T15:35:43.823606+0000","last_undegraded":"2021-07-26T15:35:43.823606+0000","last_fullsized":"2021-07-26T15:35:43.823606+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:35:42.801740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:35:42.801740+0000","last_clean_scrub_stamp":"2021-07-26T15:35:42.801740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-07-26T15:35:43.825465+0000","last_change":"2021-07-26T15:35:43.824003+0000","last_active":"2021-07-26T15:35:43.825465+0000","last_peered":"2021-07-26T15:35:43.825465+0000","last_clean":"2021-07-26T15:35:43.825465+0000","last_became_active":"2021-07-26T15:35:43.822814+0000","last_became_peered":"2021-07-26T15:35:43.822814+0000","last_unstale":"2021-07-26T15:35:43.825465+0000","last_undegraded":"2021-07-26T15:35:43.825465+0000","last_fullsized":"2021-07-26T15:35:43.825465+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:35:42.801740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:35:42.801740+0000","last_clean_scrub_stamp":"2021-07-26T15:35:42.801740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-07-26T15:35:43.825491+0000","last_change":"2021-07-26T15:35:43.823818+0000","last_active":"2021-07-26T15:35:43.825491+0000","last_peered":"2021-07-26T15:35:43.825491+0000","last_clean":"2021-07-26T15:35:43.825491+0000","last_became_active":"2021-07-26T15:35:43.821478+0000","last_became_peered":"2021-07-26T15:35:43.821478+0000","last_unstale":"2021-07-26T15:35:43.825491+0000","last_undegraded":"2021-07-26T15:35:43.825491+0000","last_fullsized":"2021-07-26T15:35:43.825491+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:35:42.801740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:35:42.801740+0000","last_clean_scrub_stamp":"2021-07-26T15:35:42.801740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-07-26T15:35:43.823548+0000","last_change":"2021-07-26T15:35:43.821770+0000","last_active":"2021-07-26T15:35:43.823548+0000","last_peered":"2021-07-26T15:35:43.823548+0000","last_clean":"2021-07-26T15:35:43.823548+0000","last_became_active":"2021-07-26T15:35:43.821059+0000","last_became_peered":"2021-07-26T15:35:43.821059+0000","last_unstale":"2021-07-26T15:35:43.823548+0000","last_undegraded":"2021-07-26T15:35:43.823548+0000","last_fullsized":"2021-07-26T15:35:43.823548+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:35:42.801740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:35:42.801740+0000","last_clean_scrub_stamp":"2021-07-26T15:35:42.801740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-07-26T15:35:43.823132+0000","last_change":"2021-07-26T15:35:43.823132+0000","last_active":"2021-07-26T15:35:43.823132+0000","last_peered":"2021-07-26T15:35:43.823132+0000","last_clean":"2021-07-26T15:35:43.823132+0000","last_became_active":"2021-07-26T15:35:43.822649+0000","last_became_peered":"2021-07-26T15:35:43.822649+0000","last_unstale":"2021-07-26T15:35:43.823132+0000","last_undegraded":"2021-07-26T15:35:43.823132+0000","last_fullsized":"2021-07-26T15:35:43.823132+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:35:42.801740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:35:42.801740+0000","last_clean_scrub_stamp":"2021-07-26T15:35:42.801740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-07-26T15:35:43.824046+0000","last_change":"2021-07-26T15:35:43.823553+0000","last_active":"2021-07-26T15:35:43.824046+0000","last_peered":"2021-07-26T15:35:43.824046+0000","last_clean":"2021-07-26T15:35:43.824046+0000","last_became_active":"2021-07-26T15:35:43.823199+0000","last_became_peered":"2021-07-26T15:35:43.823199+0000","last_unstale":"2021-07-26T15:35:43.824046+0000","last_undegraded":"2021-07-26T15:35:43.824046+0000","last_fullsized":"2021-07-26T15:35:43.824046+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:35:42.801740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:35:42.801740+0000","last_clean_scrub_stamp":"2021-07-26T15:35:42.801740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-07-26T15:35:43.828540+0000","last_change":"2021-07-26T15:35:43.825591+0000","last_active":"2021-07-26T15:35:43.828540+0000","last_peered":"2021-07-26T15:35:43.828540+0000","last_clean":"2021-07-26T15:35:43.828540+0000","last_became_active":"2021-07-26T15:35:43.825310+0000","last_became_peered":"2021-07-26T15:35:43.825310+0000","last_unstale":"2021-07-26T15:35:43.828540+0000","last_undegraded":"2021-07-26T15:35:43.828540+0000","last_fullsized":"2021-07-26T15:35:43.828540+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:35:42.801740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:35:42.801740+0000","last_clean_scrub_stamp":"2021-07-26T15:35:42.801740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-07-26T15:35:43.825507+0000","last_change":"2021-07-26T15:35:43.824302+0000","last_active":"2021-07-26T15:35:43.825507+0000","last_peered":"2021-07-26T15:35:43.825507+0000","last_clean":"2021-07-26T15:35:43.825507+0000","last_became_active":"2021-07-26T15:35:43.823818+0000","last_became_peered":"2021-07-26T15:35:43.823818+0000","last_unstale":"2021-07-26T15:35:43.825507+0000","last_undegraded":"2021-07-26T15:35:43.825507+0000","last_fullsized":"2021-07-26T15:35:43.825507+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:35:42.801740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:35:42.801740+0000","last_clean_scrub_stamp":"2021-07-26T15:35:42.801740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'1","reported_seq":13,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-07-26T15:35:43.813201+0000","last_change":"2021-07-26T15:35:40.441172+0000","last_active":"2021-07-26T15:35:43.813201+0000","last_peered":"2021-07-26T15:35:43.813201+0000","last_clean":"2021-07-26T15:35:43.813201+0000","last_became_active":"2021-07-26T15:35:40.439694+0000","last_became_peered":"2021-07-26T15:35:40.439694+0000","last_unstale":"2021-07-26T15:35:43.813201+0000","last_undegraded":"2021-07-26T15:35:43.813201+0000","last_fullsized":"2021-07-26T15:35:43.813201+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:35:37.401870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:35:37.401870+0000","last_clean_scrub_stamp":"2021-07-26T15:35:37.401870+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705668,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048704,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808896,"statfs":{"total":107374182400,"available":106300309504,"internally_reserved":1073741824,"allocated":122880,"data_stored":35760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]}]},{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048704,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808896,"statfs":{"total":107374182400,"available":106300309504,"internally_reserved":1073741824,"allocated":122880,"data_stored":35760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048696,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808904,"statfs":{"total":107374182400,"available":106300317696,"internally_reserved":1073741824,"allocated":114688,"data_stored":32280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]}]}]}} 2021-07-26T15:35:49.397 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 pg dump --format=json 2021-07-26T15:35:49.626 INFO:teuthology.orchestra.run.smithi183.stdout: 2021-07-26T15:35:49.628 INFO:teuthology.orchestra.run.smithi183.stderr:dumped all 2021-07-26T15:35:49.638 INFO:teuthology.orchestra.run.smithi183.stdout:{"pg_ready":true,"pg_map":{"version":16,"stamp":"2021-07-26T15:35:49.257000+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":11,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":3146104,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":3145728,"kb_avail":311426696,"statfs":{"total":322122547200,"available":318900936704,"internally_reserved":3221225472,"allocated":360448,"data_stored":103800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3221225472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000522"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-07-26T15:35:43.823606+0000","last_change":"2021-07-26T15:35:43.820724+0000","last_active":"2021-07-26T15:35:43.823606+0000","last_peered":"2021-07-26T15:35:43.823606+0000","last_clean":"2021-07-26T15:35:43.823606+0000","last_became_active":"2021-07-26T15:35:43.819753+0000","last_became_peered":"2021-07-26T15:35:43.819753+0000","last_unstale":"2021-07-26T15:35:43.823606+0000","last_undegraded":"2021-07-26T15:35:43.823606+0000","last_fullsized":"2021-07-26T15:35:43.823606+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:35:42.801740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:35:42.801740+0000","last_clean_scrub_stamp":"2021-07-26T15:35:42.801740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-07-26T15:35:43.825465+0000","last_change":"2021-07-26T15:35:43.824003+0000","last_active":"2021-07-26T15:35:43.825465+0000","last_peered":"2021-07-26T15:35:43.825465+0000","last_clean":"2021-07-26T15:35:43.825465+0000","last_became_active":"2021-07-26T15:35:43.822814+0000","last_became_peered":"2021-07-26T15:35:43.822814+0000","last_unstale":"2021-07-26T15:35:43.825465+0000","last_undegraded":"2021-07-26T15:35:43.825465+0000","last_fullsized":"2021-07-26T15:35:43.825465+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:35:42.801740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:35:42.801740+0000","last_clean_scrub_stamp":"2021-07-26T15:35:42.801740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-07-26T15:35:43.825491+0000","last_change":"2021-07-26T15:35:43.823818+0000","last_active":"2021-07-26T15:35:43.825491+0000","last_peered":"2021-07-26T15:35:43.825491+0000","last_clean":"2021-07-26T15:35:43.825491+0000","last_became_active":"2021-07-26T15:35:43.821478+0000","last_became_peered":"2021-07-26T15:35:43.821478+0000","last_unstale":"2021-07-26T15:35:43.825491+0000","last_undegraded":"2021-07-26T15:35:43.825491+0000","last_fullsized":"2021-07-26T15:35:43.825491+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:35:42.801740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:35:42.801740+0000","last_clean_scrub_stamp":"2021-07-26T15:35:42.801740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-07-26T15:35:43.823548+0000","last_change":"2021-07-26T15:35:43.821770+0000","last_active":"2021-07-26T15:35:43.823548+0000","last_peered":"2021-07-26T15:35:43.823548+0000","last_clean":"2021-07-26T15:35:43.823548+0000","last_became_active":"2021-07-26T15:35:43.821059+0000","last_became_peered":"2021-07-26T15:35:43.821059+0000","last_unstale":"2021-07-26T15:35:43.823548+0000","last_undegraded":"2021-07-26T15:35:43.823548+0000","last_fullsized":"2021-07-26T15:35:43.823548+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:35:42.801740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:35:42.801740+0000","last_clean_scrub_stamp":"2021-07-26T15:35:42.801740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-07-26T15:35:43.823132+0000","last_change":"2021-07-26T15:35:43.823132+0000","last_active":"2021-07-26T15:35:43.823132+0000","last_peered":"2021-07-26T15:35:43.823132+0000","last_clean":"2021-07-26T15:35:43.823132+0000","last_became_active":"2021-07-26T15:35:43.822649+0000","last_became_peered":"2021-07-26T15:35:43.822649+0000","last_unstale":"2021-07-26T15:35:43.823132+0000","last_undegraded":"2021-07-26T15:35:43.823132+0000","last_fullsized":"2021-07-26T15:35:43.823132+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:35:42.801740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:35:42.801740+0000","last_clean_scrub_stamp":"2021-07-26T15:35:42.801740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-07-26T15:35:43.824046+0000","last_change":"2021-07-26T15:35:43.823553+0000","last_active":"2021-07-26T15:35:43.824046+0000","last_peered":"2021-07-26T15:35:43.824046+0000","last_clean":"2021-07-26T15:35:43.824046+0000","last_became_active":"2021-07-26T15:35:43.823199+0000","last_became_peered":"2021-07-26T15:35:43.823199+0000","last_unstale":"2021-07-26T15:35:43.824046+0000","last_undegraded":"2021-07-26T15:35:43.824046+0000","last_fullsized":"2021-07-26T15:35:43.824046+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:35:42.801740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:35:42.801740+0000","last_clean_scrub_stamp":"2021-07-26T15:35:42.801740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-07-26T15:35:43.828540+0000","last_change":"2021-07-26T15:35:43.825591+0000","last_active":"2021-07-26T15:35:43.828540+0000","last_peered":"2021-07-26T15:35:43.828540+0000","last_clean":"2021-07-26T15:35:43.828540+0000","last_became_active":"2021-07-26T15:35:43.825310+0000","last_became_peered":"2021-07-26T15:35:43.825310+0000","last_unstale":"2021-07-26T15:35:43.828540+0000","last_undegraded":"2021-07-26T15:35:43.828540+0000","last_fullsized":"2021-07-26T15:35:43.828540+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:35:42.801740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:35:42.801740+0000","last_clean_scrub_stamp":"2021-07-26T15:35:42.801740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-07-26T15:35:43.825507+0000","last_change":"2021-07-26T15:35:43.824302+0000","last_active":"2021-07-26T15:35:43.825507+0000","last_peered":"2021-07-26T15:35:43.825507+0000","last_clean":"2021-07-26T15:35:43.825507+0000","last_became_active":"2021-07-26T15:35:43.823818+0000","last_became_peered":"2021-07-26T15:35:43.823818+0000","last_unstale":"2021-07-26T15:35:43.825507+0000","last_undegraded":"2021-07-26T15:35:43.825507+0000","last_fullsized":"2021-07-26T15:35:43.825507+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:35:42.801740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:35:42.801740+0000","last_clean_scrub_stamp":"2021-07-26T15:35:42.801740+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'1","reported_seq":13,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-07-26T15:35:43.813201+0000","last_change":"2021-07-26T15:35:40.441172+0000","last_active":"2021-07-26T15:35:43.813201+0000","last_peered":"2021-07-26T15:35:43.813201+0000","last_clean":"2021-07-26T15:35:43.813201+0000","last_became_active":"2021-07-26T15:35:40.439694+0000","last_became_peered":"2021-07-26T15:35:40.439694+0000","last_unstale":"2021-07-26T15:35:43.813201+0000","last_undegraded":"2021-07-26T15:35:43.813201+0000","last_fullsized":"2021-07-26T15:35:43.813201+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:35:37.401870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:35:37.401870+0000","last_clean_scrub_stamp":"2021-07-26T15:35:37.401870+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705668,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048704,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808896,"statfs":{"total":107374182400,"available":106300309504,"internally_reserved":1073741824,"allocated":122880,"data_stored":35760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]}]},{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048704,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808896,"statfs":{"total":107374182400,"available":106300309504,"internally_reserved":1073741824,"allocated":122880,"data_stored":35760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048696,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808904,"statfs":{"total":107374182400,"available":106300317696,"internally_reserved":1073741824,"allocated":114688,"data_stored":32280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]}]}]}} 2021-07-26T15:35:49.639 INFO:tasks.ceph.ceph_manager.c1:clean! 2021-07-26T15:35:49.640 INFO:tasks.ceph:Waiting until ceph cluster c1 is healthy... 2021-07-26T15:35:49.641 INFO:tasks.ceph.ceph_manager.c1:wait_until_healthy 2021-07-26T15:35:49.641 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 health --format=json 2021-07-26T15:35:49.916 INFO:teuthology.orchestra.run.smithi183.stdout: 2021-07-26T15:35:49.929 INFO:teuthology.orchestra.run.smithi183.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2021-07-26T15:35:49.929 INFO:tasks.ceph.ceph_manager.c1:wait_until_healthy done 2021-07-26T15:35:49.930 INFO:teuthology.run_tasks:Running task ceph... 2021-07-26T15:35:49.946 INFO:tasks.ceph:Creating ceph cluster c2... 2021-07-26T15:35:49.947 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon_warn_on_insecure_global_id_reclaim': False, 'mon_warn_on_insecure_global_id_reclaim_allowed': False}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)'], 'cpu_profile': set(), 'cluster': 'c2', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2021-07-26T15:35:49.948 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/sage-2021-07-26_15:05:01-upgrade-wip-kefu-testing-2021-07-24-1158-distro-basic-smithi/6293836', 'branch': 'wip-kefu-testing-2021-07-24-1158', 'description': 'upgrade/octopus-x/rgw-multisite/{clusters frontend overrides realm tasks upgrade/primary}', 'email': None, 'first_in_suite': False, 'job_id': '6293836', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'sage-2021-07-26_15:05:01-upgrade-wip-kefu-testing-2021-07-24-1158-distro-basic-smithi', 'nuke-on-error': True, 'overrides': {'admin_socket': {'branch': 'wip-kefu-testing-2021-07-24-1158'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon_warn_on_insecure_global_id_reclaim': False, 'mon_warn_on_insecure_global_id_reclaim_allowed': False}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'bccf07c244ef1754a7e8d345570b6a04f2ee5a7e', 'wait-for-scrub': False}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'branch': 'octopus', 'sha1': 'bccf07c244ef1754a7e8d345570b6a04f2ee5a7e'}}, 'rgw': {'compression type': 'random', 'frontend': 'beast'}, 'rgw-multisite': {'realm': {'is default': True, 'name': 'test-realm'}, 'zonegroups': [{'endpoints': ['c1.client.0'], 'is_default': True, 'is_master': True, 'name': 'test-zonegroup', 'zones': [{'endpoints': ['c1.client.0'], 'is_default': True, 'is_master': True, 'name': 'test-zone1'}, {'endpoints': ['c2.client.0'], 'is_default': True, 'name': 'test-zone2'}, {'endpoints': ['c2.client.1'], 'is_pubsub': True, 'name': 'test-zone3'}]}]}, 'rgw-multisite-tests': {'args': ['tests.py', 'tests_ps.py'], 'branch': 'octopus', 'repo': 'https://github.com/ceph/ceph.git'}, 'workunit': {'branch': 'wip-kefu-testing-2021-07-24-1158', 'sha1': 'bccf07c244ef1754a7e8d345570b6a04f2ee5a7e'}}, 'owner': 'scheduled_sage@teuthology', 'priority': 90, 'repo': 'git://git.ceph.com/ceph-ci.git', 'roles': [['c1.mon.a', 'c1.mgr.x', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0'], ['c2.mon.a', 'c2.mgr.x', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0', 'c2.client.1']], 'sha1': 'bccf07c244ef1754a7e8d345570b6a04f2ee5a7e', 'sleep_before_teardown': 0, 'suite': 'upgrade', 'suite_branch': 'wip-kefu-testing-2021-07-24-1158', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_bccf07c244ef1754a7e8d345570b6a04f2ee5a7e/qa', 'suite_relpath': 'qa', 'suite_repo': 'git://git.ceph.com/ceph-ci.git', 'suite_sha1': 'bccf07c244ef1754a7e8d345570b6a04f2ee5a7e', 'targets': {'smithi183.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDD/GJaszGqYDRTECIV+64PPxcOAHJ+vlfdUHu65iDPSknSHUVWVzJH3bjocqSKANXzu7EqxzJi+OZEpIyuJYgBmAfIBQa8kHDDBiRus1zmD90lsolWAeQbxK9gopwWvJ1pa8Dpcd4m1+po67OuSBWcA90gKMkS9J/zbqQcVPQhrV2scHCiB0ezTKAcjfk3xYfMAmjq1jVBdkNa2IFR6opL4A1nfsx4/UBazSiJzqrLr+A21hywmFrJxzuZ4Mh539B3AuxuqBsJqoTrAkMwGiSofYmgf5WxsRhQTwXT2oT+tRFt4anWQ9Q7VHkpIuBA1Us031GiEaGEeBkQgUINsBB26+b8+zxc9Dmg4Z4SUz7AxvTr8liOLfpfv3+PW8yUE27+gQ1AxO5YQS9cBQrSAAlTPTFyrK5OjSHPGNUKNb6MfFCbm/8XpRddA1Ou8OfOFTloBCscnMVZ6wI4ME6wjG/Y/YbzN69JMMKmtQZUNE+hfE7oxRMd13a4LxoL7dK3d10=', 'smithi197.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDGMPwfQjgrFUV1MRh9ksGbxFWOU2Zlm6eRIroOSl506mwAY74uYgvVew8jXHh1JtsBBRj/TepKgy65HLgqT3unQ3vXXXbRCtRhiTQeBhc3w5t+YbD1y+rpvFpc7RoFh6F92/s7Wstt7D9QlSLu10QTw6MWTcK46BG1e5jJYWLf2PM/HAJtKiJB3sKsQKaXSwYTKhwXVESW76uXf/SwAs3Qe2+uYCjIYrQqTJXDHu53IpuAcCkwJKNkhSbPMWQgH77L5fnvflWL50BkVEFpwgCWkFH464fl1N2v/l+aFkTkzDmX/Z9fDSK2JduuUmAXpkEMh40J4pFbLgP7qao/VJTkMA/JeWDN6D96G230WjRemPdd4M+Puz/WJUUQjRY/4Uojd70AI+n+zTXNEqr8DGuNbZPk/1+DIW22udhqYSFw8GWpyVN4IAbJWxlBCGi246P2+0/DymNFlBY7AzobipHkS81+Qn/ZnHG2en7GKWrov8jc4kf8HUCrJSAptXLUBkU='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'cluster': 'c1', 'conf': {'client': {'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon_warn_on_insecure_global_id_reclaim': False, 'mon_warn_on_insecure_global_id_reclaim_allowed': False}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'bccf07c244ef1754a7e8d345570b6a04f2ee5a7e', 'wait-for-scrub': False}}, {'ceph': {'cluster': 'c2', 'conf': {'client': {'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon_warn_on_insecure_global_id_reclaim': False, 'mon_warn_on_insecure_global_id_reclaim_allowed': False}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'bccf07c244ef1754a7e8d345570b6a04f2ee5a7e', 'wait-for-scrub': False}}, {'parallel': ['upgrade-task']}, {'rgw': {'c1.client.0': {'port': 8000}, 'c2.client.0': {'port': 8000}, 'c2.client.1': {'port': 8001}}}, {'rgw-multisite': None}, {'rgw-multisite-tests': {'config': {'reconfigure_delay': 60}}}], 'teuthology_branch': 'master', 'teuthology_sha1': 'b6f3efab84b70e18e86ec271a07564aeb4ed3bac', 'timestamp': '2021-07-26_15:05:01', 'tube': 'smithi', 'upgrade-task': [{'install.upgrade': {'c1.client.0': None, 'c1.mgr.x': None, 'c1.mon.a': None, 'c1.osd.0': None, 'c1.osd.1': None, 'c1.osd.2': None}}], 'user': 'sage', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.30581'} 2021-07-26T15:35:49.949 DEBUG:teuthology.orchestra.run.smithi183:> install -d -m0755 -- /home/ubuntu/cephtest/c2.data 2021-07-26T15:35:49.951 DEBUG:teuthology.orchestra.run.smithi197:> install -d -m0755 -- /home/ubuntu/cephtest/c2.data 2021-07-26T15:35:49.963 DEBUG:teuthology.orchestra.run.smithi183:> sudo install -d -m0777 -- /var/run/ceph 2021-07-26T15:35:49.966 DEBUG:teuthology.orchestra.run.smithi197:> sudo install -d -m0777 -- /var/run/ceph 2021-07-26T15:35:50.022 DEBUG:teuthology.orchestra.run.smithi197:> set -ex 2021-07-26T15:35:50.023 DEBUG:teuthology.orchestra.run.smithi197:> dd if=/scratch_devs of=/dev/stdout 2021-07-26T15:35:50.030 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-07-26T15:35:50.030 DEBUG:teuthology.orchestra.run.smithi197:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-07-26T15:35:50.039 INFO:teuthology.orchestra.run.smithi197.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-07-26T15:35:50.039 INFO:teuthology.orchestra.run.smithi197.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-07-26T15:35:50.039 INFO:teuthology.orchestra.run.smithi197.stdout:Device: 6h/6d Inode: 348 Links: 1 2021-07-26T15:35:50.040 INFO:teuthology.orchestra.run.smithi197.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-07-26T15:35:50.040 INFO:teuthology.orchestra.run.smithi197.stdout:Access: 2021-07-26 15:32:22.817672443 +0000 2021-07-26T15:35:50.040 INFO:teuthology.orchestra.run.smithi197.stdout:Modify: 2021-07-26 15:32:22.681672446 +0000 2021-07-26T15:35:50.040 INFO:teuthology.orchestra.run.smithi197.stdout:Change: 2021-07-26 15:32:22.681672446 +0000 2021-07-26T15:35:50.040 INFO:teuthology.orchestra.run.smithi197.stdout: Birth: - 2021-07-26T15:35:50.048 INFO:teuthology.orchestra.run.smithi197.stderr:1+0 records in 2021-07-26T15:35:50.048 INFO:teuthology.orchestra.run.smithi197.stderr:1+0 records out 2021-07-26T15:35:50.048 INFO:teuthology.orchestra.run.smithi197.stderr:512 bytes copied, 0.000323886 s, 1.6 MB/s 2021-07-26T15:35:50.052 DEBUG:teuthology.orchestra.run.smithi197:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-07-26T15:35:50.099 INFO:teuthology.orchestra.run.smithi197.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-07-26T15:35:50.099 INFO:teuthology.orchestra.run.smithi197.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-07-26T15:35:50.100 INFO:teuthology.orchestra.run.smithi197.stdout:Device: 6h/6d Inode: 351 Links: 1 2021-07-26T15:35:50.101 INFO:teuthology.orchestra.run.smithi197.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-07-26T15:35:50.101 INFO:teuthology.orchestra.run.smithi197.stdout:Access: 2021-07-26 15:32:23.233672433 +0000 2021-07-26T15:35:50.101 INFO:teuthology.orchestra.run.smithi197.stdout:Modify: 2021-07-26 15:32:23.061672437 +0000 2021-07-26T15:35:50.102 INFO:teuthology.orchestra.run.smithi197.stdout:Change: 2021-07-26 15:32:23.061672437 +0000 2021-07-26T15:35:50.102 INFO:teuthology.orchestra.run.smithi197.stdout: Birth: - 2021-07-26T15:35:50.110 INFO:teuthology.orchestra.run.smithi197.stderr:1+0 records in 2021-07-26T15:35:50.110 INFO:teuthology.orchestra.run.smithi197.stderr:1+0 records out 2021-07-26T15:35:50.110 INFO:teuthology.orchestra.run.smithi197.stderr:512 bytes copied, 0.000379568 s, 1.3 MB/s 2021-07-26T15:35:50.114 DEBUG:teuthology.orchestra.run.smithi197:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-07-26T15:35:50.123 INFO:teuthology.orchestra.run.smithi197.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-07-26T15:35:50.123 INFO:teuthology.orchestra.run.smithi197.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-07-26T15:35:50.123 INFO:teuthology.orchestra.run.smithi197.stdout:Device: 6h/6d Inode: 358 Links: 1 2021-07-26T15:35:50.123 INFO:teuthology.orchestra.run.smithi197.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-07-26T15:35:50.124 INFO:teuthology.orchestra.run.smithi197.stdout:Access: 2021-07-26 15:32:23.601672425 +0000 2021-07-26T15:35:50.124 INFO:teuthology.orchestra.run.smithi197.stdout:Modify: 2021-07-26 15:32:23.437672429 +0000 2021-07-26T15:35:50.124 INFO:teuthology.orchestra.run.smithi197.stdout:Change: 2021-07-26 15:32:23.437672429 +0000 2021-07-26T15:35:50.124 INFO:teuthology.orchestra.run.smithi197.stdout: Birth: - 2021-07-26T15:35:50.130 INFO:teuthology.orchestra.run.smithi197.stderr:1+0 records in 2021-07-26T15:35:50.130 INFO:teuthology.orchestra.run.smithi197.stderr:1+0 records out 2021-07-26T15:35:50.130 INFO:teuthology.orchestra.run.smithi197.stderr:512 bytes copied, 0.000390891 s, 1.3 MB/s 2021-07-26T15:35:50.134 DEBUG:teuthology.orchestra.run.smithi197:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-07-26T15:35:50.184 INFO:teuthology.orchestra.run.smithi197.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-07-26T15:35:50.184 INFO:teuthology.orchestra.run.smithi197.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-07-26T15:35:50.184 INFO:teuthology.orchestra.run.smithi197.stdout:Device: 6h/6d Inode: 367 Links: 1 2021-07-26T15:35:50.185 INFO:teuthology.orchestra.run.smithi197.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-07-26T15:35:50.186 INFO:teuthology.orchestra.run.smithi197.stdout:Access: 2021-07-26 15:32:23.985672417 +0000 2021-07-26T15:35:50.186 INFO:teuthology.orchestra.run.smithi197.stdout:Modify: 2021-07-26 15:32:23.805672421 +0000 2021-07-26T15:35:50.186 INFO:teuthology.orchestra.run.smithi197.stdout:Change: 2021-07-26 15:32:23.805672421 +0000 2021-07-26T15:35:50.187 INFO:teuthology.orchestra.run.smithi197.stdout: Birth: - 2021-07-26T15:35:50.194 INFO:teuthology.orchestra.run.smithi197.stderr:1+0 records in 2021-07-26T15:35:50.194 INFO:teuthology.orchestra.run.smithi197.stderr:1+0 records out 2021-07-26T15:35:50.195 INFO:teuthology.orchestra.run.smithi197.stderr:512 bytes copied, 0.000407517 s, 1.3 MB/s 2021-07-26T15:35:50.199 INFO:tasks.ceph:osd dev map: {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'} 2021-07-26T15:35:50.199 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi197.front.sepia.ceph.com'): {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'}} 2021-07-26T15:35:50.200 INFO:tasks.ceph:Generating config... 2021-07-26T15:35:50.201 INFO:tasks.ceph:[client] debug rgw = 20 2021-07-26T15:35:50.201 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2021-07-26T15:35:50.202 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2021-07-26T15:35:50.202 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2021-07-26T15:35:50.202 INFO:tasks.ceph:[client] rgw curl low speed time = 300 2021-07-26T15:35:50.203 INFO:tasks.ceph:[client] rgw data log num shards = 4 2021-07-26T15:35:50.203 INFO:tasks.ceph:[client] rgw md log max shards = 4 2021-07-26T15:35:50.203 INFO:tasks.ceph:[client] rgw sync log trim interval = 0 2021-07-26T15:35:50.204 INFO:tasks.ceph:[client] rgw sync obj etag verify = True 2021-07-26T15:35:50.204 INFO:tasks.ceph:[client] setgroup = ceph 2021-07-26T15:35:50.205 INFO:tasks.ceph:[client] setuser = ceph 2021-07-26T15:35:50.205 INFO:tasks.ceph:[mgr] debug mgr = 20 2021-07-26T15:35:50.205 INFO:tasks.ceph:[mgr] debug ms = 1 2021-07-26T15:35:50.205 INFO:tasks.ceph:[mon] debug mon = 20 2021-07-26T15:35:50.206 INFO:tasks.ceph:[mon] debug ms = 1 2021-07-26T15:35:50.206 INFO:tasks.ceph:[mon] debug paxos = 20 2021-07-26T15:35:50.206 INFO:tasks.ceph:[mon] mon_warn_on_insecure_global_id_reclaim = False 2021-07-26T15:35:50.207 INFO:tasks.ceph:[mon] mon_warn_on_insecure_global_id_reclaim_allowed = False 2021-07-26T15:35:50.207 INFO:tasks.ceph:[osd] debug ms = 1 2021-07-26T15:35:50.207 INFO:tasks.ceph:[osd] debug osd = 20 2021-07-26T15:35:50.208 INFO:tasks.ceph:Setting up c2.mon.a... 2021-07-26T15:35:50.208 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/c2.keyring 2021-07-26T15:35:50.251 INFO:teuthology.orchestra.run.smithi197.stdout:creating /etc/ceph/c2.keyring 2021-07-26T15:35:50.253 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/c2.keyring 2021-07-26T15:35:50.287 DEBUG:teuthology.orchestra.run.smithi197:> sudo chmod 0644 /etc/ceph/c2.keyring 2021-07-26T15:35:50.343 DEBUG:tasks.ceph:Ceph mon addresses: [('c2.mon.a', '172.21.15.197')] 2021-07-26T15:35:50.343 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.197'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug osd': 20}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': False, 'mon_warn_on_insecure_global_id_reclaim_allowed': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2021-07-26T15:35:50.344 DEBUG:teuthology.orchestra.run.smithi197:> set -ex 2021-07-26T15:35:50.345 DEBUG:teuthology.orchestra.run.smithi197:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2021-07-26T15:35:50.349 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.197 --print /home/ubuntu/cephtest/c2.monmap 2021-07-26T15:35:50.380 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:35:50.381 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:35:50.382 INFO:teuthology.orchestra.run.smithi197.stdout:monmaptool: monmap file /home/ubuntu/cephtest/c2.monmap 2021-07-26T15:35:50.382 INFO:teuthology.orchestra.run.smithi197.stdout:monmaptool: generated fsid 64cae11f-94d6-4ce7-838e-11851d4c96c5 2021-07-26T15:35:50.382 INFO:teuthology.orchestra.run.smithi197.stdout:epoch 0 2021-07-26T15:35:50.383 INFO:teuthology.orchestra.run.smithi197.stdout:fsid 64cae11f-94d6-4ce7-838e-11851d4c96c5 2021-07-26T15:35:50.383 INFO:teuthology.orchestra.run.smithi197.stdout:last_changed 2021-07-26T15:35:50.384740+0000 2021-07-26T15:35:50.383 INFO:teuthology.orchestra.run.smithi197.stdout:created 2021-07-26T15:35:50.384740+0000 2021-07-26T15:35:50.383 INFO:teuthology.orchestra.run.smithi197.stdout:min_mon_release 0 (unknown) 2021-07-26T15:35:50.384 INFO:teuthology.orchestra.run.smithi197.stdout:0: [v2:172.21.15.197:3300/0,v1:172.21.15.197:6789/0] mon.a 2021-07-26T15:35:50.384 INFO:teuthology.orchestra.run.smithi197.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/c2.monmap (1 monitors) 2021-07-26T15:35:50.384 DEBUG:teuthology.orchestra.run.smithi197:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2021-07-26T15:35:50.391 INFO:tasks.ceph:Writing /etc/ceph/c2.conf for FSID 64cae11f-94d6-4ce7-838e-11851d4c96c5... 2021-07-26T15:35:50.392 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/c2.conf && sudo chmod 0644 /etc/ceph/c2.conf > /dev/null 2021-07-26T15:35:50.395 DEBUG:teuthology.orchestra.run.smithi197:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/c2.conf && sudo chmod 0644 /etc/ceph/c2.conf > /dev/null 2021-07-26T15:35:50.437 INFO:teuthology.orchestra.run.smithi183.stdout:[global] 2021-07-26T15:35:50.437 INFO:teuthology.orchestra.run.smithi183.stdout: chdir = "" 2021-07-26T15:35:50.437 INFO:teuthology.orchestra.run.smithi183.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-07-26T15:35:50.438 INFO:teuthology.orchestra.run.smithi183.stdout: auth supported = cephx 2021-07-26T15:35:50.438 INFO:teuthology.orchestra.run.smithi183.stdout: 2021-07-26T15:35:50.438 INFO:teuthology.orchestra.run.smithi183.stdout: filestore xattr use omap = true 2021-07-26T15:35:50.438 INFO:teuthology.orchestra.run.smithi183.stdout: 2021-07-26T15:35:50.439 INFO:teuthology.orchestra.run.smithi183.stdout: mon clock drift allowed = 1.000 2021-07-26T15:35:50.439 INFO:teuthology.orchestra.run.smithi183.stdout: 2021-07-26T15:35:50.439 INFO:teuthology.orchestra.run.smithi183.stdout: osd crush chooseleaf type = 0 2021-07-26T15:35:50.439 INFO:teuthology.orchestra.run.smithi183.stdout: auth debug = true 2021-07-26T15:35:50.440 INFO:teuthology.orchestra.run.smithi183.stdout: 2021-07-26T15:35:50.440 INFO:teuthology.orchestra.run.smithi183.stdout: ms die on old message = true 2021-07-26T15:35:50.440 INFO:teuthology.orchestra.run.smithi183.stdout: ms die on bug = true 2021-07-26T15:35:50.440 INFO:teuthology.orchestra.run.smithi183.stdout: 2021-07-26T15:35:50.440 INFO:teuthology.orchestra.run.smithi183.stdout: mon max pg per osd = 10000 # >= luminous 2021-07-26T15:35:50.441 INFO:teuthology.orchestra.run.smithi183.stdout: mon pg warn max object skew = 0 2021-07-26T15:35:50.441 INFO:teuthology.orchestra.run.smithi183.stdout: 2021-07-26T15:35:50.441 INFO:teuthology.orchestra.run.smithi183.stdout: # disable pg_autoscaler by default for new pools 2021-07-26T15:35:50.441 INFO:teuthology.orchestra.run.smithi183.stdout: osd_pool_default_pg_autoscale_mode = off 2021-07-26T15:35:50.442 INFO:teuthology.orchestra.run.smithi183.stdout: 2021-07-26T15:35:50.442 INFO:teuthology.orchestra.run.smithi183.stdout: osd pool default size = 2 2021-07-26T15:35:50.442 INFO:teuthology.orchestra.run.smithi183.stdout: 2021-07-26T15:35:50.442 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd allow primary affinity = true 2021-07-26T15:35:50.443 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd allow pg remap = true 2021-07-26T15:35:50.443 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on legacy crush tunables = false 2021-07-26T15:35:50.443 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on crush straw calc version zero = false 2021-07-26T15:35:50.443 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on no sortbitwise = false 2021-07-26T15:35:50.443 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on osd down out interval zero = false 2021-07-26T15:35:50.444 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on too few osds = false 2021-07-26T15:35:50.444 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-07-26T15:35:50.444 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_pool_no_redundancy = false 2021-07-26T15:35:50.444 INFO:teuthology.orchestra.run.smithi183.stdout: mon_allow_pool_size_one = true 2021-07-26T15:35:50.445 INFO:teuthology.orchestra.run.smithi183.stdout: 2021-07-26T15:35:50.445 INFO:teuthology.orchestra.run.smithi183.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2021-07-26T15:35:50.445 INFO:teuthology.orchestra.run.smithi183.stdout: 2021-07-26T15:35:50.445 INFO:teuthology.orchestra.run.smithi183.stdout: osd default data pool replay window = 5 2021-07-26T15:35:50.445 INFO:teuthology.orchestra.run.smithi183.stdout: 2021-07-26T15:35:50.446 INFO:teuthology.orchestra.run.smithi183.stdout: mon allow pool delete = true 2021-07-26T15:35:50.446 INFO:teuthology.orchestra.run.smithi183.stdout: 2021-07-26T15:35:50.446 INFO:teuthology.orchestra.run.smithi183.stdout: mon cluster log file level = debug 2021-07-26T15:35:50.446 INFO:teuthology.orchestra.run.smithi183.stdout: debug asserts on shutdown = true 2021-07-26T15:35:50.447 INFO:teuthology.orchestra.run.smithi183.stdout: mon health detail to clog = false 2021-07-26T15:35:50.447 INFO:teuthology.orchestra.run.smithi183.stdout: mon host = 172.21.15.197 2021-07-26T15:35:50.447 INFO:teuthology.orchestra.run.smithi183.stdout: fsid = 64cae11f-94d6-4ce7-838e-11851d4c96c5 2021-07-26T15:35:50.447 INFO:teuthology.orchestra.run.smithi183.stdout: 2021-07-26T15:35:50.448 INFO:teuthology.orchestra.run.smithi183.stdout:[osd] 2021-07-26T15:35:50.448 INFO:teuthology.orchestra.run.smithi183.stdout: osd journal size = 100 2021-07-26T15:35:50.448 INFO:teuthology.orchestra.run.smithi183.stdout: 2021-07-26T15:35:50.448 INFO:teuthology.orchestra.run.smithi183.stdout: osd scrub load threshold = 5.0 2021-07-26T15:35:50.448 INFO:teuthology.orchestra.run.smithi183.stdout: osd scrub max interval = 600 2021-07-26T15:35:50.449 INFO:teuthology.orchestra.run.smithi183.stdout: 2021-07-26T15:35:50.449 INFO:teuthology.orchestra.run.smithi183.stdout: osd recover clone overlap = true 2021-07-26T15:35:50.449 INFO:teuthology.orchestra.run.smithi183.stdout: osd recovery max chunk = 1048576 2021-07-26T15:35:50.449 INFO:teuthology.orchestra.run.smithi183.stdout: 2021-07-26T15:35:50.450 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug shutdown = true 2021-07-26T15:35:50.450 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug op order = true 2021-07-26T15:35:50.450 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug verify stray on activate = true 2021-07-26T15:35:50.450 INFO:teuthology.orchestra.run.smithi183.stdout: 2021-07-26T15:35:50.450 INFO:teuthology.orchestra.run.smithi183.stdout: osd open classes on start = true 2021-07-26T15:35:50.451 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug pg log writeout = true 2021-07-26T15:35:50.451 INFO:teuthology.orchestra.run.smithi183.stdout: 2021-07-26T15:35:50.451 INFO:teuthology.orchestra.run.smithi183.stdout: osd deep scrub update digest min age = 30 2021-07-26T15:35:50.451 INFO:teuthology.orchestra.run.smithi183.stdout: 2021-07-26T15:35:50.452 INFO:teuthology.orchestra.run.smithi183.stdout: osd map max advance = 10 2021-07-26T15:35:50.452 INFO:teuthology.orchestra.run.smithi183.stdout: 2021-07-26T15:35:50.452 INFO:teuthology.orchestra.run.smithi183.stdout: journal zero on create = true 2021-07-26T15:35:50.452 INFO:teuthology.orchestra.run.smithi183.stdout: 2021-07-26T15:35:50.452 INFO:teuthology.orchestra.run.smithi183.stdout: filestore ondisk finisher threads = 3 2021-07-26T15:35:50.453 INFO:teuthology.orchestra.run.smithi183.stdout: filestore apply finisher threads = 3 2021-07-26T15:35:50.453 INFO:teuthology.orchestra.run.smithi183.stdout: 2021-07-26T15:35:50.453 INFO:teuthology.orchestra.run.smithi183.stdout: bdev debug aio = true 2021-07-26T15:35:50.453 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug misdirected ops = true 2021-07-26T15:35:50.454 INFO:teuthology.orchestra.run.smithi183.stdout: debug ms = 1 2021-07-26T15:35:50.454 INFO:teuthology.orchestra.run.smithi183.stdout: debug osd = 20 2021-07-26T15:35:50.454 INFO:teuthology.orchestra.run.smithi183.stdout: 2021-07-26T15:35:50.454 INFO:teuthology.orchestra.run.smithi183.stdout:[mgr] 2021-07-26T15:35:50.455 INFO:teuthology.orchestra.run.smithi183.stdout: debug ms = 1 2021-07-26T15:35:50.455 INFO:teuthology.orchestra.run.smithi183.stdout: debug mgr = 20 2021-07-26T15:35:50.455 INFO:teuthology.orchestra.run.smithi183.stdout: debug mon = 20 2021-07-26T15:35:50.455 INFO:teuthology.orchestra.run.smithi183.stdout: debug auth = 20 2021-07-26T15:35:50.455 INFO:teuthology.orchestra.run.smithi183.stdout: mon reweight min pgs per osd = 4 2021-07-26T15:35:50.456 INFO:teuthology.orchestra.run.smithi183.stdout: mon reweight min bytes per osd = 10 2021-07-26T15:35:50.456 INFO:teuthology.orchestra.run.smithi183.stdout: mgr/telemetry/nag = false 2021-07-26T15:35:50.456 INFO:teuthology.orchestra.run.smithi183.stdout: 2021-07-26T15:35:50.456 INFO:teuthology.orchestra.run.smithi183.stdout:[mon] 2021-07-26T15:35:50.457 INFO:teuthology.orchestra.run.smithi183.stdout: debug ms = 1 2021-07-26T15:35:50.457 INFO:teuthology.orchestra.run.smithi183.stdout: debug mon = 20 2021-07-26T15:35:50.457 INFO:teuthology.orchestra.run.smithi183.stdout: debug paxos = 20 2021-07-26T15:35:50.457 INFO:teuthology.orchestra.run.smithi183.stdout: debug auth = 20 2021-07-26T15:35:50.457 INFO:teuthology.orchestra.run.smithi183.stdout: mon data avail warn = 5 2021-07-26T15:35:50.458 INFO:teuthology.orchestra.run.smithi183.stdout: mon mgr mkfs grace = 240 2021-07-26T15:35:50.458 INFO:teuthology.orchestra.run.smithi183.stdout: mon reweight min pgs per osd = 4 2021-07-26T15:35:50.458 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd reporter subtree level = osd 2021-07-26T15:35:50.458 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd prime pg temp = true 2021-07-26T15:35:50.459 INFO:teuthology.orchestra.run.smithi183.stdout: mon reweight min bytes per osd = 10 2021-07-26T15:35:50.459 INFO:teuthology.orchestra.run.smithi183.stdout: 2021-07-26T15:35:50.459 INFO:teuthology.orchestra.run.smithi183.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-07-26T15:35:50.459 INFO:teuthology.orchestra.run.smithi183.stdout: auth mon ticket ttl = 660 # 11m 2021-07-26T15:35:50.460 INFO:teuthology.orchestra.run.smithi183.stdout: auth service ticket ttl = 240 # 4m 2021-07-26T15:35:50.460 INFO:teuthology.orchestra.run.smithi183.stdout: 2021-07-26T15:35:50.460 INFO:teuthology.orchestra.run.smithi183.stdout: # don't complain about insecure global_id in the test suite 2021-07-26T15:35:50.460 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_insecure_global_id_reclaim = False 2021-07-26T15:35:50.460 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = False 2021-07-26T15:35:50.461 INFO:teuthology.orchestra.run.smithi183.stdout: 2021-07-26T15:35:50.461 INFO:teuthology.orchestra.run.smithi183.stdout:[client] 2021-07-26T15:35:50.461 INFO:teuthology.orchestra.run.smithi183.stdout: rgw cache enabled = true 2021-07-26T15:35:50.461 INFO:teuthology.orchestra.run.smithi183.stdout: rgw enable ops log = true 2021-07-26T15:35:50.462 INFO:teuthology.orchestra.run.smithi183.stdout: rgw enable usage log = true 2021-07-26T15:35:50.462 INFO:teuthology.orchestra.run.smithi183.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-07-26T15:35:50.462 INFO:teuthology.orchestra.run.smithi183.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-07-26T15:35:50.462 INFO:teuthology.orchestra.run.smithi183.stdout: debug rgw = 20 2021-07-26T15:35:50.463 INFO:teuthology.orchestra.run.smithi183.stdout: rgw crypt require ssl = False 2021-07-26T15:35:50.463 INFO:teuthology.orchestra.run.smithi183.stdout: rgw crypt s3 kms backend = testing 2021-07-26T15:35:50.463 INFO:teuthology.orchestra.run.smithi183.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2021-07-26T15:35:50.463 INFO:teuthology.orchestra.run.smithi183.stdout: rgw curl low speed time = 300 2021-07-26T15:35:50.463 INFO:teuthology.orchestra.run.smithi183.stdout: rgw data log num shards = 4 2021-07-26T15:35:50.464 INFO:teuthology.orchestra.run.smithi183.stdout: rgw md log max shards = 4 2021-07-26T15:35:50.464 INFO:teuthology.orchestra.run.smithi183.stdout: rgw sync log trim interval = 0 2021-07-26T15:35:50.464 INFO:teuthology.orchestra.run.smithi183.stdout: rgw sync obj etag verify = True 2021-07-26T15:35:50.464 INFO:teuthology.orchestra.run.smithi183.stdout: setgroup = ceph 2021-07-26T15:35:50.465 INFO:teuthology.orchestra.run.smithi183.stdout: setuser = ceph 2021-07-26T15:35:50.465 INFO:teuthology.orchestra.run.smithi183.stdout:[mon.a] 2021-07-26T15:35:50.468 INFO:teuthology.orchestra.run.smithi197.stdout:[global] 2021-07-26T15:35:50.468 INFO:teuthology.orchestra.run.smithi197.stdout: chdir = "" 2021-07-26T15:35:50.469 INFO:teuthology.orchestra.run.smithi197.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-07-26T15:35:50.469 INFO:teuthology.orchestra.run.smithi197.stdout: auth supported = cephx 2021-07-26T15:35:50.469 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-07-26T15:35:50.469 INFO:teuthology.orchestra.run.smithi197.stdout: filestore xattr use omap = true 2021-07-26T15:35:50.469 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-07-26T15:35:50.470 INFO:teuthology.orchestra.run.smithi197.stdout: mon clock drift allowed = 1.000 2021-07-26T15:35:50.470 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-07-26T15:35:50.470 INFO:teuthology.orchestra.run.smithi197.stdout: osd crush chooseleaf type = 0 2021-07-26T15:35:50.470 INFO:teuthology.orchestra.run.smithi197.stdout: auth debug = true 2021-07-26T15:35:50.471 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-07-26T15:35:50.471 INFO:teuthology.orchestra.run.smithi197.stdout: ms die on old message = true 2021-07-26T15:35:50.471 INFO:teuthology.orchestra.run.smithi197.stdout: ms die on bug = true 2021-07-26T15:35:50.471 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-07-26T15:35:50.472 INFO:teuthology.orchestra.run.smithi197.stdout: mon max pg per osd = 10000 # >= luminous 2021-07-26T15:35:50.472 INFO:teuthology.orchestra.run.smithi197.stdout: mon pg warn max object skew = 0 2021-07-26T15:35:50.472 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-07-26T15:35:50.472 INFO:teuthology.orchestra.run.smithi197.stdout: # disable pg_autoscaler by default for new pools 2021-07-26T15:35:50.472 INFO:teuthology.orchestra.run.smithi197.stdout: osd_pool_default_pg_autoscale_mode = off 2021-07-26T15:35:50.473 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-07-26T15:35:50.473 INFO:teuthology.orchestra.run.smithi197.stdout: osd pool default size = 2 2021-07-26T15:35:50.473 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-07-26T15:35:50.473 INFO:teuthology.orchestra.run.smithi197.stdout: mon osd allow primary affinity = true 2021-07-26T15:35:50.474 INFO:teuthology.orchestra.run.smithi197.stdout: mon osd allow pg remap = true 2021-07-26T15:35:50.474 INFO:teuthology.orchestra.run.smithi197.stdout: mon warn on legacy crush tunables = false 2021-07-26T15:35:50.474 INFO:teuthology.orchestra.run.smithi197.stdout: mon warn on crush straw calc version zero = false 2021-07-26T15:35:50.474 INFO:teuthology.orchestra.run.smithi197.stdout: mon warn on no sortbitwise = false 2021-07-26T15:35:50.474 INFO:teuthology.orchestra.run.smithi197.stdout: mon warn on osd down out interval zero = false 2021-07-26T15:35:50.475 INFO:teuthology.orchestra.run.smithi197.stdout: mon warn on too few osds = false 2021-07-26T15:35:50.475 INFO:teuthology.orchestra.run.smithi197.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-07-26T15:35:50.475 INFO:teuthology.orchestra.run.smithi197.stdout: mon_warn_on_pool_no_redundancy = false 2021-07-26T15:35:50.475 INFO:teuthology.orchestra.run.smithi197.stdout: mon_allow_pool_size_one = true 2021-07-26T15:35:50.476 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-07-26T15:35:50.477 INFO:teuthology.orchestra.run.smithi197.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2021-07-26T15:35:50.478 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-07-26T15:35:50.479 INFO:teuthology.orchestra.run.smithi197.stdout: osd default data pool replay window = 5 2021-07-26T15:35:50.479 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-07-26T15:35:50.479 INFO:teuthology.orchestra.run.smithi197.stdout: mon allow pool delete = true 2021-07-26T15:35:50.479 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-07-26T15:35:50.480 INFO:teuthology.orchestra.run.smithi197.stdout: mon cluster log file level = debug 2021-07-26T15:35:50.480 INFO:teuthology.orchestra.run.smithi197.stdout: debug asserts on shutdown = true 2021-07-26T15:35:50.480 INFO:teuthology.orchestra.run.smithi197.stdout: mon health detail to clog = false 2021-07-26T15:35:50.480 INFO:teuthology.orchestra.run.smithi197.stdout: mon host = 172.21.15.197 2021-07-26T15:35:50.480 INFO:teuthology.orchestra.run.smithi197.stdout: fsid = 64cae11f-94d6-4ce7-838e-11851d4c96c5 2021-07-26T15:35:50.481 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-07-26T15:35:50.481 INFO:teuthology.orchestra.run.smithi197.stdout:[osd] 2021-07-26T15:35:50.481 INFO:teuthology.orchestra.run.smithi197.stdout: osd journal size = 100 2021-07-26T15:35:50.481 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-07-26T15:35:50.482 INFO:teuthology.orchestra.run.smithi197.stdout: osd scrub load threshold = 5.0 2021-07-26T15:35:50.482 INFO:teuthology.orchestra.run.smithi197.stdout: osd scrub max interval = 600 2021-07-26T15:35:50.482 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-07-26T15:35:50.482 INFO:teuthology.orchestra.run.smithi197.stdout: osd recover clone overlap = true 2021-07-26T15:35:50.483 INFO:teuthology.orchestra.run.smithi197.stdout: osd recovery max chunk = 1048576 2021-07-26T15:35:50.483 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-07-26T15:35:50.483 INFO:teuthology.orchestra.run.smithi197.stdout: osd debug shutdown = true 2021-07-26T15:35:50.483 INFO:teuthology.orchestra.run.smithi197.stdout: osd debug op order = true 2021-07-26T15:35:50.483 INFO:teuthology.orchestra.run.smithi197.stdout: osd debug verify stray on activate = true 2021-07-26T15:35:50.484 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-07-26T15:35:50.484 INFO:teuthology.orchestra.run.smithi197.stdout: osd open classes on start = true 2021-07-26T15:35:50.484 INFO:teuthology.orchestra.run.smithi197.stdout: osd debug pg log writeout = true 2021-07-26T15:35:50.484 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-07-26T15:35:50.485 INFO:teuthology.orchestra.run.smithi197.stdout: osd deep scrub update digest min age = 30 2021-07-26T15:35:50.485 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-07-26T15:35:50.485 INFO:teuthology.orchestra.run.smithi197.stdout: osd map max advance = 10 2021-07-26T15:35:50.485 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-07-26T15:35:50.485 INFO:teuthology.orchestra.run.smithi197.stdout: journal zero on create = true 2021-07-26T15:35:50.486 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-07-26T15:35:50.486 INFO:teuthology.orchestra.run.smithi197.stdout: filestore ondisk finisher threads = 3 2021-07-26T15:35:50.486 INFO:teuthology.orchestra.run.smithi197.stdout: filestore apply finisher threads = 3 2021-07-26T15:35:50.486 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-07-26T15:35:50.487 INFO:teuthology.orchestra.run.smithi197.stdout: bdev debug aio = true 2021-07-26T15:35:50.487 INFO:teuthology.orchestra.run.smithi197.stdout: osd debug misdirected ops = true 2021-07-26T15:35:50.487 INFO:teuthology.orchestra.run.smithi197.stdout: debug ms = 1 2021-07-26T15:35:50.487 INFO:teuthology.orchestra.run.smithi197.stdout: debug osd = 20 2021-07-26T15:35:50.487 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-07-26T15:35:50.488 INFO:teuthology.orchestra.run.smithi197.stdout:[mgr] 2021-07-26T15:35:50.488 INFO:teuthology.orchestra.run.smithi197.stdout: debug ms = 1 2021-07-26T15:35:50.488 INFO:teuthology.orchestra.run.smithi197.stdout: debug mgr = 20 2021-07-26T15:35:50.489 INFO:teuthology.orchestra.run.smithi197.stdout: debug mon = 20 2021-07-26T15:35:50.489 INFO:teuthology.orchestra.run.smithi197.stdout: debug auth = 20 2021-07-26T15:35:50.489 INFO:teuthology.orchestra.run.smithi197.stdout: mon reweight min pgs per osd = 4 2021-07-26T15:35:50.489 INFO:teuthology.orchestra.run.smithi197.stdout: mon reweight min bytes per osd = 10 2021-07-26T15:35:50.489 INFO:teuthology.orchestra.run.smithi197.stdout: mgr/telemetry/nag = false 2021-07-26T15:35:50.490 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-07-26T15:35:50.490 INFO:teuthology.orchestra.run.smithi197.stdout:[mon] 2021-07-26T15:35:50.490 INFO:teuthology.orchestra.run.smithi197.stdout: debug ms = 1 2021-07-26T15:35:50.490 INFO:teuthology.orchestra.run.smithi197.stdout: debug mon = 20 2021-07-26T15:35:50.491 INFO:teuthology.orchestra.run.smithi197.stdout: debug paxos = 20 2021-07-26T15:35:50.491 INFO:teuthology.orchestra.run.smithi197.stdout: debug auth = 20 2021-07-26T15:35:50.491 INFO:teuthology.orchestra.run.smithi197.stdout: mon data avail warn = 5 2021-07-26T15:35:50.491 INFO:teuthology.orchestra.run.smithi197.stdout: mon mgr mkfs grace = 240 2021-07-26T15:35:50.491 INFO:teuthology.orchestra.run.smithi197.stdout: mon reweight min pgs per osd = 4 2021-07-26T15:35:50.492 INFO:teuthology.orchestra.run.smithi197.stdout: mon osd reporter subtree level = osd 2021-07-26T15:35:50.492 INFO:teuthology.orchestra.run.smithi197.stdout: mon osd prime pg temp = true 2021-07-26T15:35:50.492 INFO:teuthology.orchestra.run.smithi197.stdout: mon reweight min bytes per osd = 10 2021-07-26T15:35:50.492 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-07-26T15:35:50.493 INFO:teuthology.orchestra.run.smithi197.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-07-26T15:35:50.493 INFO:teuthology.orchestra.run.smithi197.stdout: auth mon ticket ttl = 660 # 11m 2021-07-26T15:35:50.493 INFO:teuthology.orchestra.run.smithi197.stdout: auth service ticket ttl = 240 # 4m 2021-07-26T15:35:50.493 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-07-26T15:35:50.493 INFO:teuthology.orchestra.run.smithi197.stdout: # don't complain about insecure global_id in the test suite 2021-07-26T15:35:50.494 INFO:teuthology.orchestra.run.smithi197.stdout: mon_warn_on_insecure_global_id_reclaim = False 2021-07-26T15:35:50.494 INFO:teuthology.orchestra.run.smithi197.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = False 2021-07-26T15:35:50.494 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-07-26T15:35:50.494 INFO:teuthology.orchestra.run.smithi197.stdout:[client] 2021-07-26T15:35:50.495 INFO:teuthology.orchestra.run.smithi197.stdout: rgw cache enabled = true 2021-07-26T15:35:50.495 INFO:teuthology.orchestra.run.smithi197.stdout: rgw enable ops log = true 2021-07-26T15:35:50.495 INFO:teuthology.orchestra.run.smithi197.stdout: rgw enable usage log = true 2021-07-26T15:35:50.495 INFO:teuthology.orchestra.run.smithi197.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-07-26T15:35:50.495 INFO:teuthology.orchestra.run.smithi197.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-07-26T15:35:50.496 INFO:teuthology.orchestra.run.smithi197.stdout: debug rgw = 20 2021-07-26T15:35:50.496 INFO:teuthology.orchestra.run.smithi197.stdout: rgw crypt require ssl = False 2021-07-26T15:35:50.496 INFO:teuthology.orchestra.run.smithi197.stdout: rgw crypt s3 kms backend = testing 2021-07-26T15:35:50.496 INFO:teuthology.orchestra.run.smithi197.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2021-07-26T15:35:50.497 INFO:teuthology.orchestra.run.smithi197.stdout: rgw curl low speed time = 300 2021-07-26T15:35:50.497 INFO:teuthology.orchestra.run.smithi197.stdout: rgw data log num shards = 4 2021-07-26T15:35:50.497 INFO:teuthology.orchestra.run.smithi197.stdout: rgw md log max shards = 4 2021-07-26T15:35:50.497 INFO:teuthology.orchestra.run.smithi197.stdout: rgw sync log trim interval = 0 2021-07-26T15:35:50.497 INFO:teuthology.orchestra.run.smithi197.stdout: rgw sync obj etag verify = True 2021-07-26T15:35:50.498 INFO:teuthology.orchestra.run.smithi197.stdout: setgroup = ceph 2021-07-26T15:35:50.498 INFO:teuthology.orchestra.run.smithi197.stdout: setuser = ceph 2021-07-26T15:35:50.498 INFO:teuthology.orchestra.run.smithi197.stdout:[mon.a] 2021-07-26T15:35:50.499 INFO:tasks.ceph:Creating admin key on c2.mon.a... 2021-07-26T15:35:50.500 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/c2.keyring 2021-07-26T15:35:50.546 INFO:tasks.ceph:Copying monmap to all nodes... 2021-07-26T15:35:50.547 DEBUG:teuthology.orchestra.run.smithi197:> set -ex 2021-07-26T15:35:50.547 DEBUG:teuthology.orchestra.run.smithi197:> dd if=/etc/ceph/c2.keyring of=/dev/stdout 2021-07-26T15:35:50.554 DEBUG:teuthology.orchestra.run.smithi197:> set -ex 2021-07-26T15:35:50.555 DEBUG:teuthology.orchestra.run.smithi197:> dd if=/home/ubuntu/cephtest/c2.monmap of=/dev/stdout 2021-07-26T15:35:50.603 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi183.front.sepia.ceph.com 2021-07-26T15:35:50.603 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2021-07-26T15:35:50.604 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/etc/ceph/c2.keyring 2021-07-26T15:35:50.604 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 0644 /etc/ceph/c2.keyring 2021-07-26T15:35:50.630 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2021-07-26T15:35:50.630 DEBUG:teuthology.orchestra.run.smithi183:> dd of=/home/ubuntu/cephtest/c2.monmap 2021-07-26T15:35:50.680 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi197.front.sepia.ceph.com 2021-07-26T15:35:50.681 DEBUG:teuthology.orchestra.run.smithi197:> set -ex 2021-07-26T15:35:50.681 DEBUG:teuthology.orchestra.run.smithi197:> sudo dd of=/etc/ceph/c2.keyring 2021-07-26T15:35:50.683 DEBUG:teuthology.orchestra.run.smithi197:> sudo chmod 0644 /etc/ceph/c2.keyring 2021-07-26T15:35:50.711 DEBUG:teuthology.orchestra.run.smithi197:> set -ex 2021-07-26T15:35:50.712 DEBUG:teuthology.orchestra.run.smithi197:> dd of=/home/ubuntu/cephtest/c2.monmap 2021-07-26T15:35:50.760 INFO:tasks.ceph:Setting up mon nodes... 2021-07-26T15:35:50.760 INFO:tasks.ceph:Setting up mgr nodes... 2021-07-26T15:35:50.761 DEBUG:teuthology.orchestra.run.smithi197:> sudo mkdir -p /var/lib/ceph/mgr/c2-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/c2-x/keyring 2021-07-26T15:35:50.804 INFO:teuthology.orchestra.run.smithi197.stdout:creating /var/lib/ceph/mgr/c2-x/keyring 2021-07-26T15:35:50.808 INFO:tasks.ceph:Setting up mds nodes... 2021-07-26T15:35:50.808 INFO:tasks.ceph_client:Setting up client nodes... 2021-07-26T15:35:50.809 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/c2.client.0.keyring && sudo chmod 0644 /etc/ceph/c2.client.0.keyring 2021-07-26T15:35:50.881 INFO:teuthology.orchestra.run.smithi197.stdout:creating /etc/ceph/c2.client.0.keyring 2021-07-26T15:35:50.893 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/c2.client.1.keyring && sudo chmod 0644 /etc/ceph/c2.client.1.keyring 2021-07-26T15:35:50.926 INFO:teuthology.orchestra.run.smithi197.stdout:creating /etc/ceph/c2.client.1.keyring 2021-07-26T15:35:50.938 INFO:tasks.ceph:Running mkfs on osd nodes... 2021-07-26T15:35:50.939 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi183.front.sepia.ceph.com'): {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi197.front.sepia.ceph.com'): {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'}} 2021-07-26T15:35:50.939 DEBUG:teuthology.orchestra.run.smithi197:> sudo mkdir -p /var/lib/ceph/osd/c2-0 2021-07-26T15:35:50.954 INFO:tasks.ceph:roles_to_devs: {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'} 2021-07-26T15:35:50.954 INFO:tasks.ceph:role: c2.osd.0 2021-07-26T15:35:50.955 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi197.front.sepia.ceph.com 2021-07-26T15:35:50.955 DEBUG:teuthology.orchestra.run.smithi197:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2021-07-26T15:35:51.511 INFO:teuthology.orchestra.run.smithi197.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2021-07-26T15:35:51.511 INFO:teuthology.orchestra.run.smithi197.stdout: = sectsz=512 attr=2, projid32bit=1 2021-07-26T15:35:51.512 INFO:teuthology.orchestra.run.smithi197.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-07-26T15:35:51.512 INFO:teuthology.orchestra.run.smithi197.stdout: = reflink=1 2021-07-26T15:35:51.512 INFO:teuthology.orchestra.run.smithi197.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-07-26T15:35:51.512 INFO:teuthology.orchestra.run.smithi197.stdout: = sunit=0 swidth=0 blks 2021-07-26T15:35:51.512 INFO:teuthology.orchestra.run.smithi197.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-07-26T15:35:51.513 INFO:teuthology.orchestra.run.smithi197.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-07-26T15:35:51.513 INFO:teuthology.orchestra.run.smithi197.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-07-26T15:35:51.513 INFO:teuthology.orchestra.run.smithi197.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-07-26T15:35:51.514 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi197.front.sepia.ceph.com -o noatime 2021-07-26T15:35:51.515 DEBUG:teuthology.orchestra.run.smithi197:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/c2-0 2021-07-26T15:35:51.591 DEBUG:teuthology.orchestra.run.smithi197:> sudo /sbin/restorecon /var/lib/ceph/osd/c2-0 2021-07-26T15:35:51.602 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-07-26T15:35:51.603 INFO:teuthology.orchestra.run.smithi197.stderr:sudo: /sbin/restorecon: command not found 2021-07-26T15:35:51.604 DEBUG:teuthology.orchestra.run.smithi197:> sudo mkdir -p /var/lib/ceph/osd/c2-1 2021-07-26T15:35:51.615 INFO:tasks.ceph:roles_to_devs: {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'} 2021-07-26T15:35:51.616 INFO:tasks.ceph:role: c2.osd.1 2021-07-26T15:35:51.616 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi197.front.sepia.ceph.com 2021-07-26T15:35:51.616 DEBUG:teuthology.orchestra.run.smithi197:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2021-07-26T15:35:52.155 INFO:teuthology.orchestra.run.smithi197.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2021-07-26T15:35:52.156 INFO:teuthology.orchestra.run.smithi197.stdout: = sectsz=512 attr=2, projid32bit=1 2021-07-26T15:35:52.156 INFO:teuthology.orchestra.run.smithi197.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-07-26T15:35:52.156 INFO:teuthology.orchestra.run.smithi197.stdout: = reflink=1 2021-07-26T15:35:52.156 INFO:teuthology.orchestra.run.smithi197.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-07-26T15:35:52.157 INFO:teuthology.orchestra.run.smithi197.stdout: = sunit=0 swidth=0 blks 2021-07-26T15:35:52.157 INFO:teuthology.orchestra.run.smithi197.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-07-26T15:35:52.157 INFO:teuthology.orchestra.run.smithi197.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-07-26T15:35:52.157 INFO:teuthology.orchestra.run.smithi197.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-07-26T15:35:52.158 INFO:teuthology.orchestra.run.smithi197.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-07-26T15:35:52.159 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi197.front.sepia.ceph.com -o noatime 2021-07-26T15:35:52.159 DEBUG:teuthology.orchestra.run.smithi197:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/c2-1 2021-07-26T15:35:52.215 DEBUG:teuthology.orchestra.run.smithi197:> sudo /sbin/restorecon /var/lib/ceph/osd/c2-1 2021-07-26T15:35:52.227 INFO:teuthology.orchestra.run.smithi197.stderr:sudo: /sbin/restorecon: command not found 2021-07-26T15:35:52.227 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-07-26T15:35:52.228 DEBUG:teuthology.orchestra.run.smithi197:> sudo mkdir -p /var/lib/ceph/osd/c2-2 2021-07-26T15:35:52.238 INFO:tasks.ceph:roles_to_devs: {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'} 2021-07-26T15:35:52.238 INFO:tasks.ceph:role: c2.osd.2 2021-07-26T15:35:52.238 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi197.front.sepia.ceph.com 2021-07-26T15:35:52.239 DEBUG:teuthology.orchestra.run.smithi197:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2021-07-26T15:35:52.761 INFO:teuthology.orchestra.run.smithi197.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2021-07-26T15:35:52.761 INFO:teuthology.orchestra.run.smithi197.stdout: = sectsz=512 attr=2, projid32bit=1 2021-07-26T15:35:52.762 INFO:teuthology.orchestra.run.smithi197.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-07-26T15:35:52.762 INFO:teuthology.orchestra.run.smithi197.stdout: = reflink=1 2021-07-26T15:35:52.762 INFO:teuthology.orchestra.run.smithi197.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-07-26T15:35:52.762 INFO:teuthology.orchestra.run.smithi197.stdout: = sunit=0 swidth=0 blks 2021-07-26T15:35:52.763 INFO:teuthology.orchestra.run.smithi197.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-07-26T15:35:52.763 INFO:teuthology.orchestra.run.smithi197.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-07-26T15:35:52.763 INFO:teuthology.orchestra.run.smithi197.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-07-26T15:35:52.763 INFO:teuthology.orchestra.run.smithi197.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-07-26T15:35:52.764 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi197.front.sepia.ceph.com -o noatime 2021-07-26T15:35:52.765 DEBUG:teuthology.orchestra.run.smithi197:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/c2-2 2021-07-26T15:35:52.818 DEBUG:teuthology.orchestra.run.smithi197:> sudo /sbin/restorecon /var/lib/ceph/osd/c2-2 2021-07-26T15:35:52.829 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-07-26T15:35:52.830 INFO:teuthology.orchestra.run.smithi197.stderr:sudo: /sbin/restorecon: command not found 2021-07-26T15:35:52.831 DEBUG:teuthology.orchestra.run.smithi197:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c2 --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/c2.monmap 2021-07-26T15:35:52.893 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:35:52.892+0000 7f416d433d80 -1 auth: error reading file: /var/lib/ceph/osd/c2-0/keyring: can't open /var/lib/ceph/osd/c2-0/keyring: (2) No such file or directory 2021-07-26T15:35:52.893 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:35:52.892+0000 7f416d433d80 -1 created new key in keyring /var/lib/ceph/osd/c2-0/keyring 2021-07-26T15:35:52.893 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:35:52.892+0000 7f416d433d80 -1 bluestore(/var/lib/ceph/osd/c2-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-0/block: (2) No such file or directory 2021-07-26T15:35:52.894 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:35:52.892+0000 7f416d433d80 -1 bluestore(/var/lib/ceph/osd/c2-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-0/block: (2) No such file or directory 2021-07-26T15:35:52.894 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:35:52.892+0000 7f416d433d80 -1 bluestore(/var/lib/ceph/osd/c2-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-0/block: (2) No such file or directory 2021-07-26T15:35:52.894 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:35:52.896+0000 7f416d433d80 -1 bluestore(/var/lib/ceph/osd/c2-0) _read_fsid unparsable uuid 2021-07-26T15:35:52.916 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:35:52.916+0000 7f416d433d80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-07-26T15:35:54.811 DEBUG:teuthology.orchestra.run.smithi197:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c2-0 2021-07-26T15:35:54.829 DEBUG:teuthology.orchestra.run.smithi197:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c2 --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/c2.monmap 2021-07-26T15:35:54.913 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:35:54.912+0000 7fcf3f2add80 -1 auth: error reading file: /var/lib/ceph/osd/c2-1/keyring: can't open /var/lib/ceph/osd/c2-1/keyring: (2) No such file or directory 2021-07-26T15:35:54.913 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:35:54.912+0000 7fcf3f2add80 -1 created new key in keyring /var/lib/ceph/osd/c2-1/keyring 2021-07-26T15:35:54.913 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:35:54.912+0000 7fcf3f2add80 -1 bluestore(/var/lib/ceph/osd/c2-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-1/block: (2) No such file or directory 2021-07-26T15:35:54.914 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:35:54.912+0000 7fcf3f2add80 -1 bluestore(/var/lib/ceph/osd/c2-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-1/block: (2) No such file or directory 2021-07-26T15:35:54.914 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:35:54.912+0000 7fcf3f2add80 -1 bluestore(/var/lib/ceph/osd/c2-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-1/block: (2) No such file or directory 2021-07-26T15:35:54.914 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:35:54.916+0000 7fcf3f2add80 -1 bluestore(/var/lib/ceph/osd/c2-1) _read_fsid unparsable uuid 2021-07-26T15:35:54.930 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:35:54.932+0000 7fcf3f2add80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-07-26T15:35:56.848 DEBUG:teuthology.orchestra.run.smithi197:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c2-1 2021-07-26T15:35:56.865 DEBUG:teuthology.orchestra.run.smithi197:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c2 --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/c2.monmap 2021-07-26T15:35:56.951 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:35:56.952+0000 7f9f290bfd80 -1 auth: error reading file: /var/lib/ceph/osd/c2-2/keyring: can't open /var/lib/ceph/osd/c2-2/keyring: (2) No such file or directory 2021-07-26T15:35:56.951 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:35:56.952+0000 7f9f290bfd80 -1 created new key in keyring /var/lib/ceph/osd/c2-2/keyring 2021-07-26T15:35:56.951 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:35:56.952+0000 7f9f290bfd80 -1 bluestore(/var/lib/ceph/osd/c2-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-2/block: (2) No such file or directory 2021-07-26T15:35:56.952 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:35:56.952+0000 7f9f290bfd80 -1 bluestore(/var/lib/ceph/osd/c2-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-2/block: (2) No such file or directory 2021-07-26T15:35:56.952 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:35:56.952+0000 7f9f290bfd80 -1 bluestore(/var/lib/ceph/osd/c2-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-2/block: (2) No such file or directory 2021-07-26T15:35:56.953 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:35:56.952+0000 7f9f290bfd80 -1 bluestore(/var/lib/ceph/osd/c2-2) _read_fsid unparsable uuid 2021-07-26T15:35:56.970 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:35:56.972+0000 7f9f290bfd80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-07-26T15:35:58.859 DEBUG:teuthology.orchestra.run.smithi197:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c2-2 2021-07-26T15:35:58.874 INFO:tasks.ceph:Reading keys from all nodes... 2021-07-26T15:35:58.875 DEBUG:teuthology.orchestra.run.smithi197:> set -ex 2021-07-26T15:35:58.875 DEBUG:teuthology.orchestra.run.smithi197:> sudo dd if=/var/lib/ceph/mgr/c2-x/keyring of=/dev/stdout 2021-07-26T15:35:58.891 DEBUG:teuthology.orchestra.run.smithi197:> set -ex 2021-07-26T15:35:58.892 DEBUG:teuthology.orchestra.run.smithi197:> sudo dd if=/var/lib/ceph/osd/c2-0/keyring of=/dev/stdout 2021-07-26T15:35:58.947 DEBUG:teuthology.orchestra.run.smithi197:> set -ex 2021-07-26T15:35:58.948 DEBUG:teuthology.orchestra.run.smithi197:> sudo dd if=/var/lib/ceph/osd/c2-1/keyring of=/dev/stdout 2021-07-26T15:35:58.958 DEBUG:teuthology.orchestra.run.smithi197:> set -ex 2021-07-26T15:35:58.958 DEBUG:teuthology.orchestra.run.smithi197:> sudo dd if=/var/lib/ceph/osd/c2-2/keyring of=/dev/stdout 2021-07-26T15:35:58.970 DEBUG:teuthology.orchestra.run.smithi197:> set -ex 2021-07-26T15:35:58.971 DEBUG:teuthology.orchestra.run.smithi197:> dd if=/etc/ceph/c2.client.0.keyring of=/dev/stdout 2021-07-26T15:35:58.977 DEBUG:teuthology.orchestra.run.smithi197:> set -ex 2021-07-26T15:35:58.978 DEBUG:teuthology.orchestra.run.smithi197:> dd if=/etc/ceph/c2.client.1.keyring of=/dev/stdout 2021-07-26T15:35:58.984 INFO:tasks.ceph:Adding keys to all mons... 2021-07-26T15:35:58.985 DEBUG:teuthology.orchestra.run.smithi197:> sudo tee -a /etc/ceph/c2.keyring 2021-07-26T15:35:59.042 INFO:teuthology.orchestra.run.smithi197.stdout:[mgr.x] 2021-07-26T15:35:59.043 INFO:teuthology.orchestra.run.smithi197.stdout: key = AQBW1v5gGoQpMBAAsJYpJIMJYqKiPJs3UEp/KA== 2021-07-26T15:35:59.043 INFO:teuthology.orchestra.run.smithi197.stdout:[osd.0] 2021-07-26T15:35:59.043 INFO:teuthology.orchestra.run.smithi197.stdout: key = AQBY1v5g+MdsNRAAN0LKUExwarzFgyPD4dEpRQ== 2021-07-26T15:35:59.044 INFO:teuthology.orchestra.run.smithi197.stdout:[osd.1] 2021-07-26T15:35:59.044 INFO:teuthology.orchestra.run.smithi197.stdout: key = AQBa1v5gnU+fNhAA3xek2UmRbc2sqiIpfRBjMg== 2021-07-26T15:35:59.044 INFO:teuthology.orchestra.run.smithi197.stdout:[osd.2] 2021-07-26T15:35:59.044 INFO:teuthology.orchestra.run.smithi197.stdout: key = AQBc1v5gCL7kOBAAZapTTeNYWewwQKRDkU0Pjw== 2021-07-26T15:35:59.045 INFO:teuthology.orchestra.run.smithi197.stdout:[client.0] 2021-07-26T15:35:59.045 INFO:teuthology.orchestra.run.smithi197.stdout: key = AQBW1v5gV/TJNBAAKPUcccT5UYeIkL8RL9MJKw== 2021-07-26T15:35:59.045 INFO:teuthology.orchestra.run.smithi197.stdout:[client.1] 2021-07-26T15:35:59.045 INFO:teuthology.orchestra.run.smithi197.stdout: key = AQBW1v5g70tnNxAA7ucBdR9yxh2ZITWjVTVqXQ== 2021-07-26T15:35:59.048 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-07-26T15:35:59.087 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-07-26T15:35:59.131 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-07-26T15:35:59.216 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-07-26T15:35:59.260 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-07-26T15:35:59.344 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-07-26T15:35:59.390 INFO:tasks.ceph:Running mkfs on mon nodes... 2021-07-26T15:35:59.391 DEBUG:teuthology.orchestra.run.smithi197:> sudo mkdir -p /var/lib/ceph/mon/c2-a 2021-07-26T15:35:59.406 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster c2 --mkfs -i a --monmap /home/ubuntu/cephtest/c2.monmap --keyring /etc/ceph/c2.keyring 2021-07-26T15:35:59.506 DEBUG:teuthology.orchestra.run.smithi197:> sudo chown -R ceph:ceph /var/lib/ceph/mon/c2-a 2021-07-26T15:35:59.521 DEBUG:teuthology.orchestra.run.smithi197:> rm -- /home/ubuntu/cephtest/c2.monmap 2021-07-26T15:35:59.527 INFO:tasks.ceph:Starting mon daemons in cluster c2... 2021-07-26T15:35:59.529 INFO:tasks.ceph.c2.mon.a:Restarting daemon 2021-07-26T15:35:59.530 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster c2 -i a 2021-07-26T15:35:59.533 INFO:tasks.ceph.c2.mon.a:Started 2021-07-26T15:35:59.534 INFO:tasks.ceph:Starting mgr daemons in cluster c2... 2021-07-26T15:35:59.535 INFO:tasks.ceph.c2.mgr.x:Restarting daemon 2021-07-26T15:35:59.535 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster c2 -i x 2021-07-26T15:35:59.539 INFO:tasks.ceph.c2.mgr.x:Started 2021-07-26T15:35:59.539 INFO:tasks.ceph:Setting crush tunables to default 2021-07-26T15:35:59.540 DEBUG:teuthology.orchestra.run.smithi197:> sudo ceph --cluster c2 osd crush tunables default 2021-07-26T15:35:59.786 INFO:teuthology.orchestra.run.smithi197.stderr:adjusted tunables profile to default 2021-07-26T15:35:59.796 INFO:tasks.ceph:Starting osd daemons in cluster c2... 2021-07-26T15:35:59.797 DEBUG:teuthology.orchestra.run.smithi197:> set -ex 2021-07-26T15:35:59.797 DEBUG:teuthology.orchestra.run.smithi197:> sudo dd if=/var/lib/ceph/osd/c2-0/fsid of=/dev/stdout 2021-07-26T15:35:59.812 DEBUG:teuthology.orchestra.run.smithi197:> set -ex 2021-07-26T15:35:59.813 DEBUG:teuthology.orchestra.run.smithi197:> sudo dd if=/var/lib/ceph/osd/c2-1/fsid of=/dev/stdout 2021-07-26T15:35:59.825 DEBUG:teuthology.orchestra.run.smithi197:> set -ex 2021-07-26T15:35:59.825 DEBUG:teuthology.orchestra.run.smithi197:> sudo dd if=/var/lib/ceph/osd/c2-2/fsid of=/dev/stdout 2021-07-26T15:35:59.881 DEBUG:teuthology.orchestra.run.smithi197:> sudo ceph --cluster c2 osd new d3387dd3-48e0-453f-b161-c7c351fd6a53 0 2021-07-26T15:36:00.067 INFO:teuthology.orchestra.run.smithi197.stdout:0 2021-07-26T15:36:00.077 DEBUG:teuthology.orchestra.run.smithi197:> sudo ceph --cluster c2 osd new fdd75382-d3d9-40ba-a89e-072a5b11c7b0 1 2021-07-26T15:36:00.259 INFO:teuthology.orchestra.run.smithi197.stdout:1 2021-07-26T15:36:00.271 DEBUG:teuthology.orchestra.run.smithi197:> sudo ceph --cluster c2 osd new 3b6d80e0-6a60-4d72-b7e6-6ca1d5aecfe5 2 2021-07-26T15:36:00.453 INFO:teuthology.orchestra.run.smithi197.stdout:2 2021-07-26T15:36:00.470 INFO:tasks.ceph.c2.osd.0:Restarting daemon 2021-07-26T15:36:00.470 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c2 -i 0 2021-07-26T15:36:00.472 INFO:tasks.ceph.c2.osd.0:Started 2021-07-26T15:36:00.473 INFO:tasks.ceph.c2.osd.1:Restarting daemon 2021-07-26T15:36:00.473 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c2 -i 1 2021-07-26T15:36:00.478 INFO:tasks.ceph.c2.osd.1:Started 2021-07-26T15:36:00.478 INFO:tasks.ceph.c2.osd.2:Restarting daemon 2021-07-26T15:36:00.479 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c2 -i 2 2021-07-26T15:36:00.481 INFO:tasks.ceph.c2.osd.2:Started 2021-07-26T15:36:00.481 INFO:tasks.ceph:Waiting for OSDs to come up 2021-07-26T15:36:00.784 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster c2 osd dump --format=json 2021-07-26T15:36:00.961 INFO:teuthology.misc.health.smithi197.stdout: 2021-07-26T15:36:00.962 INFO:teuthology.misc.health.smithi197.stdout:{"epoch":5,"fsid":"64cae11f-94d6-4ce7-838e-11851d4c96c5","created":"2021-07-26T15:35:59.679428+0000","modified":"2021-07-26T15:36:00.453638+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"d3387dd3-48e0-453f-b161-c7c351fd6a53","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"fdd75382-d3d9-40ba-a89e-072a5b11c7b0","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3b6d80e0-6a60-4d72-b7e6-6ca1d5aecfe5","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-07-26T15:36:00.972 DEBUG:teuthology.misc:0 of 3 OSDs are up 2021-07-26T15:36:01.091 INFO:tasks.ceph.c2.osd.1.smithi197.stderr:2021-07-26T15:36:01.092+0000 7f7ea9935d80 -1 Falling back to public interface 2021-07-26T15:36:01.091 INFO:tasks.ceph.c2.osd.0.smithi197.stderr:2021-07-26T15:36:01.092+0000 7fed0b986d80 -1 Falling back to public interface 2021-07-26T15:36:01.092 INFO:tasks.ceph.c2.osd.1.smithi197.stderr:2021-07-26T15:36:01.092+0000 7f7ea9101700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6804/0: (98) Address already in use 2021-07-26T15:36:01.107 INFO:tasks.ceph.c2.osd.2.smithi197.stderr:2021-07-26T15:36:01.108+0000 7f9ff60d3d80 -1 Falling back to public interface 2021-07-26T15:36:01.722 INFO:tasks.ceph.c2.osd.2.smithi197.stderr:2021-07-26T15:36:01.724+0000 7f9ff60d3d80 -1 osd.2 0 log_to_monitors {default=true} 2021-07-26T15:36:01.726 INFO:tasks.ceph.c2.osd.0.smithi197.stderr:2021-07-26T15:36:01.728+0000 7fed0b986d80 -1 osd.0 0 log_to_monitors {default=true} 2021-07-26T15:36:01.734 INFO:tasks.ceph.c2.osd.1.smithi197.stderr:2021-07-26T15:36:01.736+0000 7f7ea9935d80 -1 osd.1 0 log_to_monitors {default=true} 2021-07-26T15:36:03.722 INFO:tasks.ceph.c2.osd.2.smithi197.stderr:2021-07-26T15:36:03.724+0000 7f9fe818d700 -1 osd.2 0 waiting for initial osdmap 2021-07-26T15:36:03.723 INFO:tasks.ceph.c2.osd.1.smithi197.stderr:2021-07-26T15:36:03.724+0000 7f7e9b9ef700 -1 osd.1 0 waiting for initial osdmap 2021-07-26T15:36:03.723 INFO:tasks.ceph.c2.osd.0.smithi197.stderr:2021-07-26T15:36:03.724+0000 7fecfda40700 -1 osd.0 0 waiting for initial osdmap 2021-07-26T15:36:07.279 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster c2 osd dump --format=json 2021-07-26T15:36:07.517 INFO:teuthology.misc.health.smithi197.stdout: 2021-07-26T15:36:07.518 INFO:teuthology.misc.health.smithi197.stdout:{"epoch":10,"fsid":"64cae11f-94d6-4ce7-838e-11851d4c96c5","created":"2021-07-26T15:35:59.679428+0000","modified":"2021-07-26T15:36:06.741698+0000","last_up_change":"2021-07-26T15:36:04.722714+0000","last_in_change":"2021-07-26T15:36:04.722714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-07-26T15:36:02.616340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"d3387dd3-48e0-453f-b161-c7c351fd6a53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6802","nonce":14345},{"type":"v1","addr":"172.21.15.197:6804","nonce":14345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6807","nonce":14345},{"type":"v1","addr":"172.21.15.197:6809","nonce":14345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6814","nonce":14345},{"type":"v1","addr":"172.21.15.197:6815","nonce":14345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6812","nonce":14345},{"type":"v1","addr":"172.21.15.197:6813","nonce":14345}]},"public_addr":"172.21.15.197:6804/14345","cluster_addr":"172.21.15.197:6809/14345","heartbeat_back_addr":"172.21.15.197:6815/14345","heartbeat_front_addr":"172.21.15.197:6813/14345","state":["exists","up"]},{"osd":1,"uuid":"fdd75382-d3d9-40ba-a89e-072a5b11c7b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":8,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6800","nonce":14346},{"type":"v1","addr":"172.21.15.197:6801","nonce":14346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6803","nonce":14346},{"type":"v1","addr":"172.21.15.197:6805","nonce":14346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6810","nonce":14346},{"type":"v1","addr":"172.21.15.197:6811","nonce":14346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6806","nonce":14346},{"type":"v1","addr":"172.21.15.197:6808","nonce":14346}]},"public_addr":"172.21.15.197:6801/14346","cluster_addr":"172.21.15.197:6805/14346","heartbeat_back_addr":"172.21.15.197:6811/14346","heartbeat_front_addr":"172.21.15.197:6808/14346","state":["exists","up"]},{"osd":2,"uuid":"3b6d80e0-6a60-4d72-b7e6-6ca1d5aecfe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6816","nonce":14347},{"type":"v1","addr":"172.21.15.197:6817","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6818","nonce":14347},{"type":"v1","addr":"172.21.15.197:6819","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6822","nonce":14347},{"type":"v1","addr":"172.21.15.197:6823","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6820","nonce":14347},{"type":"v1","addr":"172.21.15.197:6821","nonce":14347}]},"public_addr":"172.21.15.197:6817/14347","cluster_addr":"172.21.15.197:6819/14347","heartbeat_back_addr":"172.21.15.197:6823/14347","heartbeat_front_addr":"172.21.15.197:6821/14347","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:36:02.720437+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:36:02.787619+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:36:02.749948+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-07-26T15:36:07.529 DEBUG:teuthology.misc:3 of 3 OSDs are up 2021-07-26T15:36:07.529 INFO:tasks.ceph:Creating RBD pool 2021-07-26T15:36:07.530 DEBUG:teuthology.orchestra.run.smithi197:> sudo ceph --cluster c2 osd pool create rbd 8 2021-07-26T15:36:08.761 INFO:teuthology.orchestra.run.smithi197.stderr:pool 'rbd' created 2021-07-26T15:36:08.773 DEBUG:teuthology.orchestra.run.smithi197:> sudo ceph --cluster c2 osd pool application enable rbd rbd --yes-i-really-mean-it 2021-07-26T15:36:09.768 INFO:teuthology.orchestra.run.smithi197.stderr:enabled application 'rbd' on pool 'rbd' 2021-07-26T15:36:09.783 INFO:tasks.ceph:Starting mds daemons in cluster c2... 2021-07-26T15:36:09.783 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd dump --format=json 2021-07-26T15:36:09.784 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2021-07-26T15:36:10.025 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-07-26T15:36:10.025 INFO:teuthology.orchestra.run.smithi197.stdout:{"epoch":12,"fsid":"64cae11f-94d6-4ce7-838e-11851d4c96c5","created":"2021-07-26T15:35:59.679428+0000","modified":"2021-07-26T15:36:09.754572+0000","last_up_change":"2021-07-26T15:36:04.722714+0000","last_in_change":"2021-07-26T15:36:04.722714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-07-26T15:36:02.616340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-07-26T15:36:07.842489+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"d3387dd3-48e0-453f-b161-c7c351fd6a53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6802","nonce":14345},{"type":"v1","addr":"172.21.15.197:6804","nonce":14345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6807","nonce":14345},{"type":"v1","addr":"172.21.15.197:6809","nonce":14345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6814","nonce":14345},{"type":"v1","addr":"172.21.15.197:6815","nonce":14345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6812","nonce":14345},{"type":"v1","addr":"172.21.15.197:6813","nonce":14345}]},"public_addr":"172.21.15.197:6804/14345","cluster_addr":"172.21.15.197:6809/14345","heartbeat_back_addr":"172.21.15.197:6815/14345","heartbeat_front_addr":"172.21.15.197:6813/14345","state":["exists","up"]},{"osd":1,"uuid":"fdd75382-d3d9-40ba-a89e-072a5b11c7b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6800","nonce":14346},{"type":"v1","addr":"172.21.15.197:6801","nonce":14346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6803","nonce":14346},{"type":"v1","addr":"172.21.15.197:6805","nonce":14346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6810","nonce":14346},{"type":"v1","addr":"172.21.15.197:6811","nonce":14346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6806","nonce":14346},{"type":"v1","addr":"172.21.15.197:6808","nonce":14346}]},"public_addr":"172.21.15.197:6801/14346","cluster_addr":"172.21.15.197:6805/14346","heartbeat_back_addr":"172.21.15.197:6811/14346","heartbeat_front_addr":"172.21.15.197:6808/14346","state":["exists","up"]},{"osd":2,"uuid":"3b6d80e0-6a60-4d72-b7e6-6ca1d5aecfe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6816","nonce":14347},{"type":"v1","addr":"172.21.15.197:6817","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6818","nonce":14347},{"type":"v1","addr":"172.21.15.197:6819","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6822","nonce":14347},{"type":"v1","addr":"172.21.15.197:6823","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6820","nonce":14347},{"type":"v1","addr":"172.21.15.197:6821","nonce":14347}]},"public_addr":"172.21.15.197:6817/14347","cluster_addr":"172.21.15.197:6819/14347","heartbeat_back_addr":"172.21.15.197:6823/14347","heartbeat_front_addr":"172.21.15.197:6821/14347","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:36:02.720437+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:36:02.787619+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:36:02.749948+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-07-26T15:36:10.038 INFO:tasks.ceph.ceph_manager.c2:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-07-26T15:36:02.616340+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '10', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-07-26T15:36:07.842489+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-07-26T15:36:10.038 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd pool get device_health_metrics pg_num 2021-07-26T15:36:10.288 INFO:teuthology.orchestra.run.smithi197.stdout:pg_num: 1 2021-07-26T15:36:10.301 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd pool get rbd pg_num 2021-07-26T15:36:10.547 INFO:teuthology.orchestra.run.smithi197.stdout:pg_num: 8 2021-07-26T15:36:10.566 INFO:tasks.ceph:Waiting until c2 daemons up and pgs clean... 2021-07-26T15:36:10.566 INFO:tasks.ceph.ceph_manager.c2:waiting for mgr available 2021-07-26T15:36:10.567 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 mgr dump --format=json 2021-07-26T15:36:10.840 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-07-26T15:36:10.852 INFO:teuthology.orchestra.run.smithi197.stdout:{"epoch":4,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6824","nonce":14158},{"type":"v1","addr":"172.21.15.197:6825","nonce":14158}]},"active_addr":"172.21.15.197:6825/14158","active_change":"2021-07-26T15:36:02.558780+0000","active_mgr_features":4540138292840890367,"available":true,"standbys":[],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.197:0","nonce":1991259004}]},{"addrvec":[{"type":"v2","addr":"172.21.15.197:0","nonce":872565857}]},{"addrvec":[{"type":"v2","addr":"172.21.15.197:0","nonce":472281948}]}]}} 2021-07-26T15:36:10.854 INFO:tasks.ceph.ceph_manager.c2:mgr available! 2021-07-26T15:36:10.854 INFO:tasks.ceph.ceph_manager.c2:waiting for all up 2021-07-26T15:36:10.855 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd dump --format=json 2021-07-26T15:36:11.097 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-07-26T15:36:11.097 INFO:teuthology.orchestra.run.smithi197.stdout:{"epoch":13,"fsid":"64cae11f-94d6-4ce7-838e-11851d4c96c5","created":"2021-07-26T15:35:59.679428+0000","modified":"2021-07-26T15:36:10.762866+0000","last_up_change":"2021-07-26T15:36:04.722714+0000","last_in_change":"2021-07-26T15:36:04.722714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-07-26T15:36:02.616340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-07-26T15:36:07.842489+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"d3387dd3-48e0-453f-b161-c7c351fd6a53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6802","nonce":14345},{"type":"v1","addr":"172.21.15.197:6804","nonce":14345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6807","nonce":14345},{"type":"v1","addr":"172.21.15.197:6809","nonce":14345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6814","nonce":14345},{"type":"v1","addr":"172.21.15.197:6815","nonce":14345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6812","nonce":14345},{"type":"v1","addr":"172.21.15.197:6813","nonce":14345}]},"public_addr":"172.21.15.197:6804/14345","cluster_addr":"172.21.15.197:6809/14345","heartbeat_back_addr":"172.21.15.197:6815/14345","heartbeat_front_addr":"172.21.15.197:6813/14345","state":["exists","up"]},{"osd":1,"uuid":"fdd75382-d3d9-40ba-a89e-072a5b11c7b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6800","nonce":14346},{"type":"v1","addr":"172.21.15.197:6801","nonce":14346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6803","nonce":14346},{"type":"v1","addr":"172.21.15.197:6805","nonce":14346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6810","nonce":14346},{"type":"v1","addr":"172.21.15.197:6811","nonce":14346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6806","nonce":14346},{"type":"v1","addr":"172.21.15.197:6808","nonce":14346}]},"public_addr":"172.21.15.197:6801/14346","cluster_addr":"172.21.15.197:6805/14346","heartbeat_back_addr":"172.21.15.197:6811/14346","heartbeat_front_addr":"172.21.15.197:6808/14346","state":["exists","up"]},{"osd":2,"uuid":"3b6d80e0-6a60-4d72-b7e6-6ca1d5aecfe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6816","nonce":14347},{"type":"v1","addr":"172.21.15.197:6817","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6818","nonce":14347},{"type":"v1","addr":"172.21.15.197:6819","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6822","nonce":14347},{"type":"v1","addr":"172.21.15.197:6823","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6820","nonce":14347},{"type":"v1","addr":"172.21.15.197:6821","nonce":14347}]},"public_addr":"172.21.15.197:6817/14347","cluster_addr":"172.21.15.197:6819/14347","heartbeat_back_addr":"172.21.15.197:6823/14347","heartbeat_front_addr":"172.21.15.197:6821/14347","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:36:02.720437+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:36:02.787619+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:36:02.749948+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-07-26T15:36:11.115 INFO:tasks.ceph.ceph_manager.c2:all up! 2021-07-26T15:36:11.115 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd dump --format=json 2021-07-26T15:36:11.358 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-07-26T15:36:11.358 INFO:teuthology.orchestra.run.smithi197.stdout:{"epoch":13,"fsid":"64cae11f-94d6-4ce7-838e-11851d4c96c5","created":"2021-07-26T15:35:59.679428+0000","modified":"2021-07-26T15:36:10.762866+0000","last_up_change":"2021-07-26T15:36:04.722714+0000","last_in_change":"2021-07-26T15:36:04.722714+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-07-26T15:36:02.616340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-07-26T15:36:07.842489+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"d3387dd3-48e0-453f-b161-c7c351fd6a53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6802","nonce":14345},{"type":"v1","addr":"172.21.15.197:6804","nonce":14345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6807","nonce":14345},{"type":"v1","addr":"172.21.15.197:6809","nonce":14345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6814","nonce":14345},{"type":"v1","addr":"172.21.15.197:6815","nonce":14345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6812","nonce":14345},{"type":"v1","addr":"172.21.15.197:6813","nonce":14345}]},"public_addr":"172.21.15.197:6804/14345","cluster_addr":"172.21.15.197:6809/14345","heartbeat_back_addr":"172.21.15.197:6815/14345","heartbeat_front_addr":"172.21.15.197:6813/14345","state":["exists","up"]},{"osd":1,"uuid":"fdd75382-d3d9-40ba-a89e-072a5b11c7b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6800","nonce":14346},{"type":"v1","addr":"172.21.15.197:6801","nonce":14346}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6803","nonce":14346},{"type":"v1","addr":"172.21.15.197:6805","nonce":14346}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6810","nonce":14346},{"type":"v1","addr":"172.21.15.197:6811","nonce":14346}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6806","nonce":14346},{"type":"v1","addr":"172.21.15.197:6808","nonce":14346}]},"public_addr":"172.21.15.197:6801/14346","cluster_addr":"172.21.15.197:6805/14346","heartbeat_back_addr":"172.21.15.197:6811/14346","heartbeat_front_addr":"172.21.15.197:6808/14346","state":["exists","up"]},{"osd":2,"uuid":"3b6d80e0-6a60-4d72-b7e6-6ca1d5aecfe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6816","nonce":14347},{"type":"v1","addr":"172.21.15.197:6817","nonce":14347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6818","nonce":14347},{"type":"v1","addr":"172.21.15.197:6819","nonce":14347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6822","nonce":14347},{"type":"v1","addr":"172.21.15.197:6823","nonce":14347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.197:6820","nonce":14347},{"type":"v1","addr":"172.21.15.197:6821","nonce":14347}]},"public_addr":"172.21.15.197:6817/14347","cluster_addr":"172.21.15.197:6819/14347","heartbeat_back_addr":"172.21.15.197:6823/14347","heartbeat_front_addr":"172.21.15.197:6821/14347","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:36:02.720437+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:36:02.787619+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:36:02.749948+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-07-26T15:36:11.379 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 tell osd.0 flush_pg_stats 2021-07-26T15:36:11.530 INFO:teuthology.orchestra.run.smithi197.stdout:34359738372 2021-07-26T15:36:11.531 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 tell osd.1 flush_pg_stats 2021-07-26T15:36:11.674 INFO:teuthology.orchestra.run.smithi197.stdout:34359738371 2021-07-26T15:36:11.675 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 tell osd.2 flush_pg_stats 2021-07-26T15:36:11.829 INFO:teuthology.orchestra.run.smithi197.stdout:34359738372 2021-07-26T15:36:11.830 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd last-stat-seq osd.0 2021-07-26T15:36:12.077 INFO:teuthology.orchestra.run.smithi197.stdout:34359738370 2021-07-26T15:36:12.090 INFO:tasks.ceph.ceph_manager.c2:need seq 34359738372 got 34359738370 for osd.0 2021-07-26T15:36:13.092 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd last-stat-seq osd.0 2021-07-26T15:36:13.346 INFO:teuthology.orchestra.run.smithi197.stdout:34359738372 2021-07-26T15:36:13.376 INFO:tasks.ceph.ceph_manager.c2:need seq 34359738372 got 34359738372 for osd.0 2021-07-26T15:36:13.377 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd last-stat-seq osd.1 2021-07-26T15:36:13.630 INFO:teuthology.orchestra.run.smithi197.stdout:34359738371 2021-07-26T15:36:13.642 INFO:tasks.ceph.ceph_manager.c2:need seq 34359738371 got 34359738371 for osd.1 2021-07-26T15:36:13.643 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd last-stat-seq osd.2 2021-07-26T15:36:13.876 INFO:teuthology.orchestra.run.smithi197.stdout:34359738372 2021-07-26T15:36:13.888 INFO:tasks.ceph.ceph_manager.c2:need seq 34359738372 got 34359738372 for osd.2 2021-07-26T15:36:13.888 INFO:tasks.ceph.ceph_manager.c2:waiting for clean 2021-07-26T15:36:13.889 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 pg dump --format=json 2021-07-26T15:36:14.123 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-07-26T15:36:14.125 INFO:teuthology.orchestra.run.smithi197.stderr:dumped all 2021-07-26T15:36:14.135 INFO:teuthology.orchestra.run.smithi197.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2021-07-26T15:36:12.568504+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":3146064,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":3145728,"kb_avail":311426736,"statfs":{"total":322122547200,"available":318900977664,"internally_reserved":3221225472,"allocated":319488,"data_stored":88782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3221225472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.800239"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2021-07-26T15:36:09.778119+0000","last_change":"2021-07-26T15:36:09.771569+0000","last_active":"2021-07-26T15:36:09.778119+0000","last_peered":"2021-07-26T15:36:09.778119+0000","last_clean":"2021-07-26T15:36:09.778119+0000","last_became_active":"2021-07-26T15:36:09.770773+0000","last_became_peered":"2021-07-26T15:36:09.770773+0000","last_unstale":"2021-07-26T15:36:09.778119+0000","last_undegraded":"2021-07-26T15:36:09.778119+0000","last_fullsized":"2021-07-26T15:36:09.778119+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:36:08.748415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:36:08.748415+0000","last_clean_scrub_stamp":"2021-07-26T15:36:08.748415+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2021-07-26T15:36:09.774914+0000","last_change":"2021-07-26T15:36:09.770285+0000","last_active":"2021-07-26T15:36:09.774914+0000","last_peered":"2021-07-26T15:36:09.774914+0000","last_clean":"2021-07-26T15:36:09.774914+0000","last_became_active":"2021-07-26T15:36:09.769683+0000","last_became_peered":"2021-07-26T15:36:09.769683+0000","last_unstale":"2021-07-26T15:36:09.774914+0000","last_undegraded":"2021-07-26T15:36:09.774914+0000","last_fullsized":"2021-07-26T15:36:09.774914+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:36:08.748415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:36:08.748415+0000","last_clean_scrub_stamp":"2021-07-26T15:36:08.748415+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2021-07-26T15:36:09.774891+0000","last_change":"2021-07-26T15:36:09.769538+0000","last_active":"2021-07-26T15:36:09.774891+0000","last_peered":"2021-07-26T15:36:09.774891+0000","last_clean":"2021-07-26T15:36:09.774891+0000","last_became_active":"2021-07-26T15:36:09.769262+0000","last_became_peered":"2021-07-26T15:36:09.769262+0000","last_unstale":"2021-07-26T15:36:09.774891+0000","last_undegraded":"2021-07-26T15:36:09.774891+0000","last_fullsized":"2021-07-26T15:36:09.774891+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:36:08.748415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:36:08.748415+0000","last_clean_scrub_stamp":"2021-07-26T15:36:08.748415+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2021-07-26T15:36:09.778110+0000","last_change":"2021-07-26T15:36:09.771572+0000","last_active":"2021-07-26T15:36:09.778110+0000","last_peered":"2021-07-26T15:36:09.778110+0000","last_clean":"2021-07-26T15:36:09.778110+0000","last_became_active":"2021-07-26T15:36:09.770700+0000","last_became_peered":"2021-07-26T15:36:09.770700+0000","last_unstale":"2021-07-26T15:36:09.778110+0000","last_undegraded":"2021-07-26T15:36:09.778110+0000","last_fullsized":"2021-07-26T15:36:09.778110+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:36:08.748415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:36:08.748415+0000","last_clean_scrub_stamp":"2021-07-26T15:36:08.748415+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":8,"reported_epoch":12,"state":"active+clean","last_fresh":"2021-07-26T15:36:09.771830+0000","last_change":"2021-07-26T15:36:09.771830+0000","last_active":"2021-07-26T15:36:09.771830+0000","last_peered":"2021-07-26T15:36:09.771830+0000","last_clean":"2021-07-26T15:36:09.771830+0000","last_became_active":"2021-07-26T15:36:09.771510+0000","last_became_peered":"2021-07-26T15:36:09.771510+0000","last_unstale":"2021-07-26T15:36:09.771830+0000","last_undegraded":"2021-07-26T15:36:09.771830+0000","last_fullsized":"2021-07-26T15:36:09.771830+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:36:08.748415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:36:08.748415+0000","last_clean_scrub_stamp":"2021-07-26T15:36:08.748415+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":8,"reported_epoch":12,"state":"active+clean","last_fresh":"2021-07-26T15:36:09.771182+0000","last_change":"2021-07-26T15:36:09.771182+0000","last_active":"2021-07-26T15:36:09.771182+0000","last_peered":"2021-07-26T15:36:09.771182+0000","last_clean":"2021-07-26T15:36:09.771182+0000","last_became_active":"2021-07-26T15:36:09.770837+0000","last_became_peered":"2021-07-26T15:36:09.770837+0000","last_unstale":"2021-07-26T15:36:09.771182+0000","last_undegraded":"2021-07-26T15:36:09.771182+0000","last_fullsized":"2021-07-26T15:36:09.771182+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:36:08.748415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:36:08.748415+0000","last_clean_scrub_stamp":"2021-07-26T15:36:08.748415+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":8,"reported_epoch":12,"state":"active+clean","last_fresh":"2021-07-26T15:36:09.770209+0000","last_change":"2021-07-26T15:36:09.770209+0000","last_active":"2021-07-26T15:36:09.770209+0000","last_peered":"2021-07-26T15:36:09.770209+0000","last_clean":"2021-07-26T15:36:09.770209+0000","last_became_active":"2021-07-26T15:36:09.769743+0000","last_became_peered":"2021-07-26T15:36:09.769743+0000","last_unstale":"2021-07-26T15:36:09.770209+0000","last_undegraded":"2021-07-26T15:36:09.770209+0000","last_fullsized":"2021-07-26T15:36:09.770209+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:36:08.748415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:36:08.748415+0000","last_clean_scrub_stamp":"2021-07-26T15:36:08.748415+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2021-07-26T15:36:09.774849+0000","last_change":"2021-07-26T15:36:09.769593+0000","last_active":"2021-07-26T15:36:09.774849+0000","last_peered":"2021-07-26T15:36:09.774849+0000","last_clean":"2021-07-26T15:36:09.774849+0000","last_became_active":"2021-07-26T15:36:09.769312+0000","last_became_peered":"2021-07-26T15:36:09.769312+0000","last_unstale":"2021-07-26T15:36:09.774849+0000","last_undegraded":"2021-07-26T15:36:09.774849+0000","last_fullsized":"2021-07-26T15:36:09.774849+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:36:08.748415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:36:08.748415+0000","last_clean_scrub_stamp":"2021-07-26T15:36:08.748415+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"9'1","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2021-07-26T15:36:09.768567+0000","last_change":"2021-07-26T15:36:06.635348+0000","last_active":"2021-07-26T15:36:09.768567+0000","last_peered":"2021-07-26T15:36:09.768567+0000","last_clean":"2021-07-26T15:36:09.768567+0000","last_became_active":"2021-07-26T15:36:06.633985+0000","last_became_peered":"2021-07-26T15:36:06.633985+0000","last_unstale":"2021-07-26T15:36:09.768567+0000","last_undegraded":"2021-07-26T15:36:09.768567+0000","last_fullsized":"2021-07-26T15:36:09.768567+0000","mapping_epoch":8,"log_start":"0'0","ondisk_log_start":"0'0","created":6,"last_epoch_clean":9,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:36:02.698826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:36:02.698826+0000","last_clean_scrub_stamp":"2021-07-26T15:36:02.698826+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048688,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808912,"statfs":{"total":107374182400,"available":106300325888,"internally_reserved":1073741824,"allocated":106496,"data_stored":29594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]}]},{"osd":1,"up_from":8,"seq":34359738371,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048688,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808912,"statfs":{"total":107374182400,"available":106300325888,"internally_reserved":1073741824,"allocated":106496,"data_stored":29594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]}]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048688,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808912,"statfs":{"total":107374182400,"available":106300325888,"internally_reserved":1073741824,"allocated":106496,"data_stored":29594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]}]}]}} 2021-07-26T15:36:14.136 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 pg dump --format=json 2021-07-26T15:36:14.371 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-07-26T15:36:14.373 INFO:teuthology.orchestra.run.smithi197.stderr:dumped all 2021-07-26T15:36:14.382 INFO:teuthology.orchestra.run.smithi197.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2021-07-26T15:36:12.568504+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":3146064,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":3145728,"kb_avail":311426736,"statfs":{"total":322122547200,"available":318900977664,"internally_reserved":3221225472,"allocated":319488,"data_stored":88782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3221225472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.800239"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2021-07-26T15:36:09.778119+0000","last_change":"2021-07-26T15:36:09.771569+0000","last_active":"2021-07-26T15:36:09.778119+0000","last_peered":"2021-07-26T15:36:09.778119+0000","last_clean":"2021-07-26T15:36:09.778119+0000","last_became_active":"2021-07-26T15:36:09.770773+0000","last_became_peered":"2021-07-26T15:36:09.770773+0000","last_unstale":"2021-07-26T15:36:09.778119+0000","last_undegraded":"2021-07-26T15:36:09.778119+0000","last_fullsized":"2021-07-26T15:36:09.778119+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:36:08.748415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:36:08.748415+0000","last_clean_scrub_stamp":"2021-07-26T15:36:08.748415+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2021-07-26T15:36:09.774914+0000","last_change":"2021-07-26T15:36:09.770285+0000","last_active":"2021-07-26T15:36:09.774914+0000","last_peered":"2021-07-26T15:36:09.774914+0000","last_clean":"2021-07-26T15:36:09.774914+0000","last_became_active":"2021-07-26T15:36:09.769683+0000","last_became_peered":"2021-07-26T15:36:09.769683+0000","last_unstale":"2021-07-26T15:36:09.774914+0000","last_undegraded":"2021-07-26T15:36:09.774914+0000","last_fullsized":"2021-07-26T15:36:09.774914+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:36:08.748415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:36:08.748415+0000","last_clean_scrub_stamp":"2021-07-26T15:36:08.748415+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2021-07-26T15:36:09.774891+0000","last_change":"2021-07-26T15:36:09.769538+0000","last_active":"2021-07-26T15:36:09.774891+0000","last_peered":"2021-07-26T15:36:09.774891+0000","last_clean":"2021-07-26T15:36:09.774891+0000","last_became_active":"2021-07-26T15:36:09.769262+0000","last_became_peered":"2021-07-26T15:36:09.769262+0000","last_unstale":"2021-07-26T15:36:09.774891+0000","last_undegraded":"2021-07-26T15:36:09.774891+0000","last_fullsized":"2021-07-26T15:36:09.774891+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:36:08.748415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:36:08.748415+0000","last_clean_scrub_stamp":"2021-07-26T15:36:08.748415+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2021-07-26T15:36:09.778110+0000","last_change":"2021-07-26T15:36:09.771572+0000","last_active":"2021-07-26T15:36:09.778110+0000","last_peered":"2021-07-26T15:36:09.778110+0000","last_clean":"2021-07-26T15:36:09.778110+0000","last_became_active":"2021-07-26T15:36:09.770700+0000","last_became_peered":"2021-07-26T15:36:09.770700+0000","last_unstale":"2021-07-26T15:36:09.778110+0000","last_undegraded":"2021-07-26T15:36:09.778110+0000","last_fullsized":"2021-07-26T15:36:09.778110+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:36:08.748415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:36:08.748415+0000","last_clean_scrub_stamp":"2021-07-26T15:36:08.748415+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":8,"reported_epoch":12,"state":"active+clean","last_fresh":"2021-07-26T15:36:09.771830+0000","last_change":"2021-07-26T15:36:09.771830+0000","last_active":"2021-07-26T15:36:09.771830+0000","last_peered":"2021-07-26T15:36:09.771830+0000","last_clean":"2021-07-26T15:36:09.771830+0000","last_became_active":"2021-07-26T15:36:09.771510+0000","last_became_peered":"2021-07-26T15:36:09.771510+0000","last_unstale":"2021-07-26T15:36:09.771830+0000","last_undegraded":"2021-07-26T15:36:09.771830+0000","last_fullsized":"2021-07-26T15:36:09.771830+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:36:08.748415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:36:08.748415+0000","last_clean_scrub_stamp":"2021-07-26T15:36:08.748415+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":8,"reported_epoch":12,"state":"active+clean","last_fresh":"2021-07-26T15:36:09.771182+0000","last_change":"2021-07-26T15:36:09.771182+0000","last_active":"2021-07-26T15:36:09.771182+0000","last_peered":"2021-07-26T15:36:09.771182+0000","last_clean":"2021-07-26T15:36:09.771182+0000","last_became_active":"2021-07-26T15:36:09.770837+0000","last_became_peered":"2021-07-26T15:36:09.770837+0000","last_unstale":"2021-07-26T15:36:09.771182+0000","last_undegraded":"2021-07-26T15:36:09.771182+0000","last_fullsized":"2021-07-26T15:36:09.771182+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:36:08.748415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:36:08.748415+0000","last_clean_scrub_stamp":"2021-07-26T15:36:08.748415+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":8,"reported_epoch":12,"state":"active+clean","last_fresh":"2021-07-26T15:36:09.770209+0000","last_change":"2021-07-26T15:36:09.770209+0000","last_active":"2021-07-26T15:36:09.770209+0000","last_peered":"2021-07-26T15:36:09.770209+0000","last_clean":"2021-07-26T15:36:09.770209+0000","last_became_active":"2021-07-26T15:36:09.769743+0000","last_became_peered":"2021-07-26T15:36:09.769743+0000","last_unstale":"2021-07-26T15:36:09.770209+0000","last_undegraded":"2021-07-26T15:36:09.770209+0000","last_fullsized":"2021-07-26T15:36:09.770209+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:36:08.748415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:36:08.748415+0000","last_clean_scrub_stamp":"2021-07-26T15:36:08.748415+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2021-07-26T15:36:09.774849+0000","last_change":"2021-07-26T15:36:09.769593+0000","last_active":"2021-07-26T15:36:09.774849+0000","last_peered":"2021-07-26T15:36:09.774849+0000","last_clean":"2021-07-26T15:36:09.774849+0000","last_became_active":"2021-07-26T15:36:09.769312+0000","last_became_peered":"2021-07-26T15:36:09.769312+0000","last_unstale":"2021-07-26T15:36:09.774849+0000","last_undegraded":"2021-07-26T15:36:09.774849+0000","last_fullsized":"2021-07-26T15:36:09.774849+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:36:08.748415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:36:08.748415+0000","last_clean_scrub_stamp":"2021-07-26T15:36:08.748415+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"9'1","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2021-07-26T15:36:09.768567+0000","last_change":"2021-07-26T15:36:06.635348+0000","last_active":"2021-07-26T15:36:09.768567+0000","last_peered":"2021-07-26T15:36:09.768567+0000","last_clean":"2021-07-26T15:36:09.768567+0000","last_became_active":"2021-07-26T15:36:06.633985+0000","last_became_peered":"2021-07-26T15:36:06.633985+0000","last_unstale":"2021-07-26T15:36:09.768567+0000","last_undegraded":"2021-07-26T15:36:09.768567+0000","last_fullsized":"2021-07-26T15:36:09.768567+0000","mapping_epoch":8,"log_start":"0'0","ondisk_log_start":"0'0","created":6,"last_epoch_clean":9,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:36:02.698826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:36:02.698826+0000","last_clean_scrub_stamp":"2021-07-26T15:36:02.698826+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048688,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808912,"statfs":{"total":107374182400,"available":106300325888,"internally_reserved":1073741824,"allocated":106496,"data_stored":29594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]}]},{"osd":1,"up_from":8,"seq":34359738371,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048688,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808912,"statfs":{"total":107374182400,"available":106300325888,"internally_reserved":1073741824,"allocated":106496,"data_stored":29594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]}]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048688,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808912,"statfs":{"total":107374182400,"available":106300325888,"internally_reserved":1073741824,"allocated":106496,"data_stored":29594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]}]}]}} 2021-07-26T15:36:14.383 INFO:tasks.ceph.ceph_manager.c2:clean! 2021-07-26T15:36:14.385 INFO:tasks.ceph:Waiting until ceph cluster c2 is healthy... 2021-07-26T15:36:14.385 INFO:tasks.ceph.ceph_manager.c2:wait_until_healthy 2021-07-26T15:36:14.386 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 health --format=json 2021-07-26T15:36:14.667 INFO:teuthology.orchestra.run.smithi197.stdout: 2021-07-26T15:36:14.679 INFO:teuthology.orchestra.run.smithi197.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2021-07-26T15:36:14.686 INFO:tasks.ceph.ceph_manager.c2:wait_until_healthy done 2021-07-26T15:36:14.687 INFO:teuthology.run_tasks:Running task parallel... 2021-07-26T15:36:14.701 INFO:teuthology.task.parallel:starting parallel... 2021-07-26T15:36:14.702 INFO:teuthology.task.parallel:In parallel, running task sequential... 2021-07-26T15:36:14.703 INFO:teuthology.task.sequential:In sequential, running task install.upgrade... 2021-07-26T15:36:14.704 INFO:teuthology.task.install:project ceph config {'c1.client.0': None, 'c1.mgr.x': None, 'c1.mon.a': None, 'c1.osd.0': None, 'c1.osd.1': None, 'c1.osd.2': None} overrides {'branch': 'octopus', 'sha1': 'bccf07c244ef1754a7e8d345570b6a04f2ee5a7e'} 2021-07-26T15:36:14.704 WARNING:teuthology.task.install:remote ubuntu@smithi183.front.sepia.ceph.com came up twice (role c1.mgr.x) 2021-07-26T15:36:14.704 WARNING:teuthology.task.install:remote ubuntu@smithi183.front.sepia.ceph.com came up twice (role c1.mon.a) 2021-07-26T15:36:14.705 WARNING:teuthology.task.install:remote ubuntu@smithi183.front.sepia.ceph.com came up twice (role c1.osd.0) 2021-07-26T15:36:14.705 WARNING:teuthology.task.install:remote ubuntu@smithi183.front.sepia.ceph.com came up twice (role c1.osd.1) 2021-07-26T15:36:14.705 WARNING:teuthology.task.install:remote ubuntu@smithi183.front.sepia.ceph.com came up twice (role c1.osd.2) 2021-07-26T15:36:14.706 INFO:teuthology.task.install:remote ubuntu@smithi183.front.sepia.ceph.com config {'branch': 'octopus', 'sha1': 'bccf07c244ef1754a7e8d345570b6a04f2ee5a7e'} 2021-07-26T15:36:14.706 INFO:teuthology.task.install:extra packages: [] 2021-07-26T15:36:14.706 DEBUG:teuthology.orchestra.run.smithi183:> sudo lsb_release -is 2021-07-26T15:36:14.758 INFO:teuthology.orchestra.run.smithi183.stdout:Ubuntu 2021-07-26T15:36:14.772 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-07-26T15:36:14.779 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2021-07-26T15:36:14.780 INFO:teuthology.task.install:Upgrading ceph deb packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse 2021-07-26T15:36:14.780 DEBUG:teuthology.orchestra.run.smithi183:> dpkg-query -W -f '${Version}' ceph-common 2021-07-26T15:36:14.804 INFO:teuthology.orchestra.run.smithi183.stdout:15.2.13-213-g0f589fd5-1focal 2021-07-26T15:36:14.804 INFO:teuthology.packaging:The installed version of ceph-common is 15.2.13-213-g0f589fd5-1focal 2021-07-26T15:36:14.805 DEBUG:teuthology.orchestra.run.smithi183:> sudo lsb_release -is 2021-07-26T15:36:14.894 INFO:teuthology.orchestra.run.smithi183.stdout:Ubuntu 2021-07-26T15:36:14.905 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-07-26T15:36:14.906 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-07-26T15:36:14.906 INFO:teuthology.packaging:ref: None 2021-07-26T15:36:14.907 INFO:teuthology.packaging:tag: None 2021-07-26T15:36:14.907 INFO:teuthology.packaging:branch: octopus 2021-07-26T15:36:14.907 INFO:teuthology.packaging:sha1: bccf07c244ef1754a7e8d345570b6a04f2ee5a7e 2021-07-26T15:36:14.908 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=octopus 2021-07-26T15:36:15.192 INFO:teuthology.task.install:Ceph deb upgrade from 15.2.13-213-g0f589fd5-1focal to 15.2.13-213-g0f589fd5-1focal 2021-07-26T15:36:15.193 DEBUG:teuthology.orchestra.run.smithi183:> sudo apt-key list | grep Ceph 2021-07-26T15:36:15.296 INFO:teuthology.orchestra.run.smithi183.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-07-26T15:36:15.355 INFO:teuthology.orchestra.run.smithi183.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-07-26T15:36:15.355 INFO:teuthology.orchestra.run.smithi183.stdout:uid [ unknown] Ceph.com (release key) 2021-07-26T15:36:15.355 DEBUG:teuthology.orchestra.run.smithi183:> sudo lsb_release -is 2021-07-26T15:36:15.403 INFO:teuthology.orchestra.run.smithi183.stdout:Ubuntu 2021-07-26T15:36:15.408 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-07-26T15:36:15.409 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-07-26T15:36:15.409 INFO:teuthology.packaging:ref: None 2021-07-26T15:36:15.409 INFO:teuthology.packaging:tag: None 2021-07-26T15:36:15.410 INFO:teuthology.packaging:branch: octopus 2021-07-26T15:36:15.410 INFO:teuthology.packaging:sha1: bccf07c244ef1754a7e8d345570b6a04f2ee5a7e 2021-07-26T15:36:15.411 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=octopus 2021-07-26T15:36:15.737 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default/ 2021-07-26T15:36:15.737 INFO:teuthology.task.install.deb:Package version is 15.2.13-213-g0f589fd5-1focal 2021-07-26T15:36:15.942 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2021-07-26T15:36:15.942 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-07-26T15:36:15.961 DEBUG:teuthology.orchestra.run.smithi183:> sudo apt-get update 2021-07-26T15:36:16.192 INFO:teuthology.orchestra.run.smithi183.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2021-07-26T15:36:16.201 INFO:teuthology.orchestra.run.smithi183.stdout:Ign:2 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal InRelease 2021-07-26T15:36:16.226 INFO:teuthology.orchestra.run.smithi183.stdout:Hit:3 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal Release 2021-07-26T15:36:16.247 INFO:teuthology.orchestra.run.smithi183.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal InRelease 2021-07-26T15:36:16.256 INFO:teuthology.orchestra.run.smithi183.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal Release.gpg 2021-07-26T15:36:16.317 INFO:teuthology.orchestra.run.smithi183.stdout:Hit:6 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-07-26T15:36:16.399 INFO:teuthology.orchestra.run.smithi183.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-07-26T15:36:16.555 INFO:teuthology.orchestra.run.smithi183.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [789 kB] 2021-07-26T15:36:16.648 INFO:teuthology.orchestra.run.smithi183.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [268 kB] 2021-07-26T15:36:16.652 INFO:teuthology.orchestra.run.smithi183.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [17.9 kB] 2021-07-26T15:36:16.653 INFO:teuthology.orchestra.run.smithi183.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [331 kB] 2021-07-26T15:36:16.658 INFO:teuthology.orchestra.run.smithi183.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [47.6 kB] 2021-07-26T15:36:16.660 INFO:teuthology.orchestra.run.smithi183.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [633 kB] 2021-07-26T15:36:16.670 INFO:teuthology.orchestra.run.smithi183.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [505 kB] 2021-07-26T15:36:16.674 INFO:teuthology.orchestra.run.smithi183.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [21.6 kB] 2021-07-26T15:36:16.674 INFO:teuthology.orchestra.run.smithi183.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [6,464 B] 2021-07-26T15:36:16.675 INFO:teuthology.orchestra.run.smithi183.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [4,648 B] 2021-07-26T15:36:17.050 INFO:teuthology.orchestra.run.smithi183.stdout:Fetched 2,838 kB in 1s (3,111 kB/s) 2021-07-26T15:36:17.828 INFO:teuthology.orchestra.run.smithi183.stdout:Reading package lists... 2021-07-26T15:36:17.851 DEBUG:teuthology.orchestra.run.smithi183:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.13-213-g0f589fd5-1focal cephadm=15.2.13-213-g0f589fd5-1focal ceph-mds=15.2.13-213-g0f589fd5-1focal ceph-mgr=15.2.13-213-g0f589fd5-1focal ceph-common=15.2.13-213-g0f589fd5-1focal ceph-fuse=15.2.13-213-g0f589fd5-1focal ceph-test=15.2.13-213-g0f589fd5-1focal radosgw=15.2.13-213-g0f589fd5-1focal python3-rados=15.2.13-213-g0f589fd5-1focal python3-rgw=15.2.13-213-g0f589fd5-1focal python3-cephfs=15.2.13-213-g0f589fd5-1focal python3-rbd=15.2.13-213-g0f589fd5-1focal libcephfs2=15.2.13-213-g0f589fd5-1focal libcephfs-dev=15.2.13-213-g0f589fd5-1focal librados2=15.2.13-213-g0f589fd5-1focal librbd1=15.2.13-213-g0f589fd5-1focal rbd-fuse=15.2.13-213-g0f589fd5-1focal 2021-07-26T15:36:17.914 INFO:teuthology.orchestra.run.smithi183.stdout:Reading package lists... 2021-07-26T15:36:18.076 INFO:teuthology.orchestra.run.smithi183.stdout:Building dependency tree... 2021-07-26T15:36:18.077 INFO:teuthology.orchestra.run.smithi183.stdout:Reading state information... 2021-07-26T15:36:18.212 INFO:teuthology.orchestra.run.smithi183.stdout:ceph is already the newest version (15.2.13-213-g0f589fd5-1focal). 2021-07-26T15:36:18.212 INFO:teuthology.orchestra.run.smithi183.stdout:ceph-common is already the newest version (15.2.13-213-g0f589fd5-1focal). 2021-07-26T15:36:18.212 INFO:teuthology.orchestra.run.smithi183.stdout:ceph-fuse is already the newest version (15.2.13-213-g0f589fd5-1focal). 2021-07-26T15:36:18.213 INFO:teuthology.orchestra.run.smithi183.stdout:ceph-mds is already the newest version (15.2.13-213-g0f589fd5-1focal). 2021-07-26T15:36:18.213 INFO:teuthology.orchestra.run.smithi183.stdout:ceph-mgr is already the newest version (15.2.13-213-g0f589fd5-1focal). 2021-07-26T15:36:18.213 INFO:teuthology.orchestra.run.smithi183.stdout:ceph-test is already the newest version (15.2.13-213-g0f589fd5-1focal). 2021-07-26T15:36:18.213 INFO:teuthology.orchestra.run.smithi183.stdout:cephadm is already the newest version (15.2.13-213-g0f589fd5-1focal). 2021-07-26T15:36:18.214 INFO:teuthology.orchestra.run.smithi183.stdout:libcephfs-dev is already the newest version (15.2.13-213-g0f589fd5-1focal). 2021-07-26T15:36:18.214 INFO:teuthology.orchestra.run.smithi183.stdout:libcephfs2 is already the newest version (15.2.13-213-g0f589fd5-1focal). 2021-07-26T15:36:18.214 INFO:teuthology.orchestra.run.smithi183.stdout:librados2 is already the newest version (15.2.13-213-g0f589fd5-1focal). 2021-07-26T15:36:18.214 INFO:teuthology.orchestra.run.smithi183.stdout:librados2 set to manually installed. 2021-07-26T15:36:18.215 INFO:teuthology.orchestra.run.smithi183.stdout:librbd1 is already the newest version (15.2.13-213-g0f589fd5-1focal). 2021-07-26T15:36:18.215 INFO:teuthology.orchestra.run.smithi183.stdout:librbd1 set to manually installed. 2021-07-26T15:36:18.215 INFO:teuthology.orchestra.run.smithi183.stdout:python3-cephfs is already the newest version (15.2.13-213-g0f589fd5-1focal). 2021-07-26T15:36:18.215 INFO:teuthology.orchestra.run.smithi183.stdout:python3-rados is already the newest version (15.2.13-213-g0f589fd5-1focal). 2021-07-26T15:36:18.215 INFO:teuthology.orchestra.run.smithi183.stdout:python3-rbd is already the newest version (15.2.13-213-g0f589fd5-1focal). 2021-07-26T15:36:18.216 INFO:teuthology.orchestra.run.smithi183.stdout:python3-rgw is already the newest version (15.2.13-213-g0f589fd5-1focal). 2021-07-26T15:36:18.216 INFO:teuthology.orchestra.run.smithi183.stdout:radosgw is already the newest version (15.2.13-213-g0f589fd5-1focal). 2021-07-26T15:36:18.216 INFO:teuthology.orchestra.run.smithi183.stdout:rbd-fuse is already the newest version (15.2.13-213-g0f589fd5-1focal). 2021-07-26T15:36:18.216 INFO:teuthology.orchestra.run.smithi183.stdout:The following packages were automatically installed and are no longer required: 2021-07-26T15:36:18.217 INFO:teuthology.orchestra.run.smithi183.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2021-07-26T15:36:18.217 INFO:teuthology.orchestra.run.smithi183.stdout:Use 'sudo apt autoremove' to remove them. 2021-07-26T15:36:18.264 INFO:teuthology.orchestra.run.smithi183.stdout:0 upgraded, 0 newly installed, 0 to remove and 143 not upgraded. 2021-07-26T15:36:18.265 INFO:teuthology.orchestra.run.smithi183.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-07-26T15:36:18.267 DEBUG:teuthology.orchestra.run.smithi183:> sudo lsb_release -is 2021-07-26T15:36:18.311 INFO:teuthology.orchestra.run.smithi183.stdout:Ubuntu 2021-07-26T15:36:18.316 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-07-26T15:36:18.316 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-07-26T15:36:18.317 INFO:teuthology.packaging:ref: None 2021-07-26T15:36:18.317 INFO:teuthology.packaging:tag: None 2021-07-26T15:36:18.317 INFO:teuthology.packaging:branch: octopus 2021-07-26T15:36:18.318 INFO:teuthology.packaging:sha1: bccf07c244ef1754a7e8d345570b6a04f2ee5a7e 2021-07-26T15:36:18.318 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=octopus 2021-07-26T15:36:18.560 DEBUG:teuthology.orchestra.run.smithi183:> dpkg-query -W -f '${Version}' ceph 2021-07-26T15:36:18.590 INFO:teuthology.orchestra.run.smithi183.stdout:15.2.13-213-g0f589fd5-1focal 2021-07-26T15:36:18.590 INFO:teuthology.packaging:The installed version of ceph is 15.2.13-213-g0f589fd5-1focal 2021-07-26T15:36:18.591 INFO:teuthology.task.install:The correct ceph version 15.2.13-213-g0f589fd5-1focal is installed. 2021-07-26T15:36:18.591 DEBUG:teuthology.parallel:result is None 2021-07-26T15:36:18.591 INFO:teuthology.run_tasks:Running task rgw... 2021-07-26T15:36:18.611 DEBUG:tasks.rgw:config is {'c1.client.0': {'port': 8000}, 'c2.client.0': {'port': 8000}, 'c2.client.1': {'port': 8001}} 2021-07-26T15:36:18.611 DEBUG:tasks.rgw:client list is dict_keys(['c1.client.0', 'c2.client.0', 'c2.client.1']) 2021-07-26T15:36:18.612 INFO:tasks.rgw:Creating data pools 2021-07-26T15:36:18.612 DEBUG:tasks.rgw:Obtaining remote for client c1.client.0 2021-07-26T15:36:18.613 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster c1 2021-07-26T15:36:19.413 INFO:teuthology.orchestra.run.smithi183.stderr:pool 'default.rgw.buckets.data' created 2021-07-26T15:36:19.428 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster c1 2021-07-26T15:36:20.426 INFO:teuthology.orchestra.run.smithi183.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2021-07-26T15:36:20.442 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster c1 2021-07-26T15:36:21.433 INFO:teuthology.orchestra.run.smithi183.stderr:pool 'default.rgw.buckets.index' created 2021-07-26T15:36:21.448 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster c1 2021-07-26T15:36:22.461 INFO:teuthology.orchestra.run.smithi183.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2021-07-26T15:36:22.471 DEBUG:tasks.rgw:Obtaining remote for client c2.client.0 2021-07-26T15:36:22.472 DEBUG:teuthology.orchestra.run.smithi197:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster c2 2021-07-26T15:36:23.682 INFO:teuthology.orchestra.run.smithi197.stderr:pool 'default.rgw.buckets.data' created 2021-07-26T15:36:23.692 DEBUG:teuthology.orchestra.run.smithi197:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster c2 2021-07-26T15:36:24.702 INFO:teuthology.orchestra.run.smithi197.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2021-07-26T15:36:24.712 DEBUG:teuthology.orchestra.run.smithi197:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster c2 2021-07-26T15:36:25.693 INFO:teuthology.orchestra.run.smithi197.stderr:pool 'default.rgw.buckets.index' created 2021-07-26T15:36:25.705 DEBUG:teuthology.orchestra.run.smithi197:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster c2 2021-07-26T15:36:26.719 INFO:teuthology.orchestra.run.smithi197.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2021-07-26T15:36:26.730 DEBUG:tasks.rgw:Obtaining remote for client c2.client.1 2021-07-26T15:36:26.731 DEBUG:teuthology.orchestra.run.smithi197:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster c2 2021-07-26T15:36:26.978 INFO:teuthology.orchestra.run.smithi197.stderr:pool 'default.rgw.buckets.data' already exists 2021-07-26T15:36:26.987 DEBUG:teuthology.orchestra.run.smithi197:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster c2 2021-07-26T15:36:27.691 INFO:teuthology.orchestra.run.smithi197.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2021-07-26T15:36:27.705 DEBUG:teuthology.orchestra.run.smithi197:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster c2 2021-07-26T15:36:27.964 INFO:teuthology.orchestra.run.smithi197.stderr:pool 'default.rgw.buckets.index' already exists 2021-07-26T15:36:27.973 DEBUG:teuthology.orchestra.run.smithi197:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster c2 2021-07-26T15:36:28.702 INFO:teuthology.orchestra.run.smithi197.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2021-07-26T15:36:28.713 DEBUG:tasks.rgw:Pools created 2021-07-26T15:36:28.714 INFO:tasks.rgw:Configuring compression type = random 2021-07-26T15:36:28.715 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['user', 'list'] 2021-07-26T15:36:28.716 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'user', 'list'] 2021-07-26T15:36:28.716 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 user list 2021-07-26T15:36:28.752 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:36:28.753 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:36:28.764 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:28.769+0000 7f71898af980 20 rados->read ofs=0 len=0 2021-07-26T15:36:30.344 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:30.349+0000 7f71898af980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:36:30.345 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:30.349+0000 7f71898af980 20 rados->read ofs=0 len=0 2021-07-26T15:36:30.345 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:30.349+0000 7f71898af980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:36:30.346 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:30.349+0000 7f71898af980 20 rados->read ofs=0 len=0 2021-07-26T15:36:30.346 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:30.353+0000 7f71898af980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:36:30.346 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:30.353+0000 7f71898af980 20 rados->read ofs=0 len=0 2021-07-26T15:36:30.347 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:30.353+0000 7f71898af980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:36:30.365 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:30.369+0000 7f71898af980 20 rados->read ofs=0 len=0 2021-07-26T15:36:30.366 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:30.369+0000 7f71898af980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:36:30.366 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:30.369+0000 7f71898af980 20 rados->read ofs=0 len=0 2021-07-26T15:36:30.366 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:30.373+0000 7f71898af980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:36:30.367 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:30.373+0000 7f71898af980 20 rados->read ofs=0 len=0 2021-07-26T15:36:30.367 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:30.373+0000 7f71898af980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:36:30.367 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:30.373+0000 7f71898af980 10 cannot find current period zonegroup using local zonegroup 2021-07-26T15:36:30.367 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:30.373+0000 7f71898af980 20 rados->read ofs=0 len=0 2021-07-26T15:36:30.368 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:30.373+0000 7f71898af980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:36:30.368 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:30.373+0000 7f71898af980 20 rados->read ofs=0 len=0 2021-07-26T15:36:30.369 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:30.373+0000 7f71898af980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:36:30.369 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:30.373+0000 7f71898af980 10 Creating default zonegroup 2021-07-26T15:36:30.369 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:30.373+0000 7f71898af980 20 get_system_obj_state: rctx=0x7ffc0b7e1c10 obj=:.pools.avail state=0x564e181a8820 s->prefetch_data=0 2021-07-26T15:36:30.369 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:30.373+0000 7f71898af980 10 couldn't find old data placement pools config, setting up new ones for the zone 2021-07-26T15:36:30.379 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:30.385+0000 7f71898af980 10 WARNING: store->list_zones() returned r=-2 2021-07-26T15:36:30.379 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:30.385+0000 7f71898af980 20 rados->read ofs=0 len=0 2021-07-26T15:36:30.380 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:30.385+0000 7f71898af980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:36:30.384 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:30.389+0000 7f71898af980 20 rados->read ofs=0 len=0 2021-07-26T15:36:30.385 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:30.389+0000 7f71898af980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:36:30.385 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:30.389+0000 7f71898af980 10 could not read realm id: (2) No such file or directory 2021-07-26T15:36:30.385 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:30.389+0000 7f71898af980 10 WARNING: failed to set zone as default, r=-22 2021-07-26T15:36:30.385 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:30.389+0000 7f71898af980 20 rados->read ofs=0 len=0 2021-07-26T15:36:30.386 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:30.389+0000 7f71898af980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:36:30.389 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:30.397+0000 7f71898af980 20 rados->read ofs=0 len=0 2021-07-26T15:36:30.390 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:30.397+0000 7f71898af980 20 rados_obj.operate() r=0 bl.length=839 2021-07-26T15:36:30.391 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:30.397+0000 7f71898af980 20 rados->read ofs=0 len=0 2021-07-26T15:36:30.391 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:30.397+0000 7f71898af980 20 rados_obj.operate() r=0 bl.length=358 2021-07-26T15:36:30.392 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:30.397+0000 7f71898af980 20 zonegroup default 2021-07-26T15:36:30.392 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:30.397+0000 7f71898af980 20 rados->read ofs=0 len=0 2021-07-26T15:36:30.393 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:30.397+0000 7f71898af980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:36:30.393 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:30.397+0000 7f71898af980 10 Cannot find current period zone using local zone 2021-07-26T15:36:30.393 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:30.397+0000 7f71898af980 10 Using default name default 2021-07-26T15:36:30.393 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:30.397+0000 7f71898af980 20 rados->read ofs=0 len=0 2021-07-26T15:36:30.394 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:30.397+0000 7f71898af980 20 rados_obj.operate() r=0 bl.length=46 2021-07-26T15:36:30.394 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:30.397+0000 7f71898af980 20 rados->read ofs=0 len=0 2021-07-26T15:36:30.395 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:30.401+0000 7f71898af980 20 rados_obj.operate() r=0 bl.length=839 2021-07-26T15:36:30.395 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:30.401+0000 7f71898af980 20 zone default found 2021-07-26T15:36:30.395 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:30.401+0000 7f71898af980 20 rados->read ofs=0 len=0 2021-07-26T15:36:32.364 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:32.369+0000 7f71898af980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:36:32.365 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:32.369+0000 7f71898af980 20 rados->read ofs=0 len=0 2021-07-26T15:36:32.365 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:32.369+0000 7f71898af980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:36:32.365 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:32.369+0000 7f71898af980 20 started sync module instance, tier type = 2021-07-26T15:36:32.365 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:32.369+0000 7f71898af980 20 started zone id=ce8b804e-2a13-40d6-9daa-1ea26488fdaf (name=default) with tier type = 2021-07-26T15:36:34.418 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:34.425+0000 7f71898af980 20 add_watcher() i=0 2021-07-26T15:36:34.418 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:34.425+0000 7f71898af980 20 add_watcher() i=1 2021-07-26T15:36:34.418 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:34.425+0000 7f71898af980 20 add_watcher() i=2 2021-07-26T15:36:34.419 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:34.425+0000 7f71898af980 20 add_watcher() i=3 2021-07-26T15:36:34.419 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:34.425+0000 7f71898af980 20 add_watcher() i=4 2021-07-26T15:36:34.419 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:34.425+0000 7f71898af980 20 add_watcher() i=5 2021-07-26T15:36:34.419 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:34.425+0000 7f71898af980 20 add_watcher() i=6 2021-07-26T15:36:34.420 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:34.425+0000 7f71898af980 20 add_watcher() i=7 2021-07-26T15:36:34.420 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:34.425+0000 7f71898af980 2 all 8 watchers are set, enabling cache 2021-07-26T15:36:34.421 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:34.425+0000 7f71898af980 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2021-07-26T15:36:34.421 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:34.425+0000 7f71898af980 20 check_secure_mon_conn(): mode 1 is insecure 2021-07-26T15:36:34.421 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:34.425+0000 7f70d3fff700 2 RGWDataChangesLog::ChangesRenewThread: start 2021-07-26T15:36:38.405 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:38.412+0000 7f71898af980 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2021-07-26T15:36:38.516 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:38.524+0000 7f70c27fc700 20 reqs_thread_entry: start 2021-07-26T15:36:38.516 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:38.524+0000 7f70b3fff700 20 reqs_thread_entry: start 2021-07-26T15:36:38.516 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:38.524+0000 7f71898af980 20 init_complete bucket index max shards: 11 2021-07-26T15:36:38.517 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:38.524+0000 7f70b27fc700 20 reqs_thread_entry: start 2021-07-26T15:36:38.541 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:38.548+0000 7f70d3fff700 2 RGWDataChangesLog::ChangesRenewThread: start 2021-07-26T15:36:38.543 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:38.552+0000 7f71898af980 20 remove_watcher() i=0 2021-07-26T15:36:38.543 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:38.552+0000 7f71898af980 2 removed watcher, disabling cache 2021-07-26T15:36:38.546 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:38.552+0000 7f71898af980 20 remove_watcher() i=1 2021-07-26T15:36:38.548 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:38.556+0000 7f71898af980 20 remove_watcher() i=2 2021-07-26T15:36:38.551 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:38.560+0000 7f71898af980 20 remove_watcher() i=3 2021-07-26T15:36:38.554 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:38.560+0000 7f71898af980 20 remove_watcher() i=4 2021-07-26T15:36:38.556 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:38.564+0000 7f71898af980 20 remove_watcher() i=5 2021-07-26T15:36:38.559 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:38.568+0000 7f71898af980 20 remove_watcher() i=6 2021-07-26T15:36:38.562 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:38.568+0000 7f71898af980 20 remove_watcher() i=7 2021-07-26T15:36:38.570 INFO:teuthology.orchestra.run.smithi183.stdout:[] 2021-07-26T15:36:38.571 DEBUG:tasks.util.rgw: json result: [] 2021-07-26T15:36:38.572 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2021-07-26T15:36:38.573 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2021-07-26T15:36:38.573 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone placement modify --rgw-zone default --placement-id default-placement --compression random 2021-07-26T15:36:38.611 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:36:38.612 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:36:38.626 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:38.632+0000 7f3e29b23980 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2021-07-26T15:36:38.627 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:38.632+0000 7f3e29b23980 20 check_secure_mon_conn(): mode 1 is insecure 2021-07-26T15:36:38.632 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:38.640+0000 7f3d6b7fe700 20 reqs_thread_entry: start 2021-07-26T15:36:38.632 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:38.640+0000 7f3e29b23980 20 rados->read ofs=0 len=0 2021-07-26T15:36:38.636 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:38.640+0000 7f3e29b23980 20 rados_obj.operate() r=0 bl.length=46 2021-07-26T15:36:38.637 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:38.640+0000 7f3e29b23980 20 rados->read ofs=0 len=0 2021-07-26T15:36:38.637 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:38.644+0000 7f3e29b23980 20 rados_obj.operate() r=0 bl.length=839 2021-07-26T15:36:38.637 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:38.644+0000 7f3e29b23980 20 rados->read ofs=0 len=0 2021-07-26T15:36:38.637 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:38.644+0000 7f3e29b23980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:36:38.638 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:38.644+0000 7f3e29b23980 20 rados->read ofs=0 len=0 2021-07-26T15:36:38.638 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:38.644+0000 7f3e29b23980 20 rados_obj.operate() r=0 bl.length=46 2021-07-26T15:36:38.638 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:38.644+0000 7f3e29b23980 20 rados->read ofs=0 len=0 2021-07-26T15:36:38.638 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:38.644+0000 7f3e29b23980 20 rados_obj.operate() r=0 bl.length=358 2021-07-26T15:36:38.647 INFO:teuthology.orchestra.run.smithi183.stdout:{"id":"ce8b804e-2a13-40d6-9daa-1ea26488fdaf","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0}}],"realm_id":""} 2021-07-26T15:36:38.647 DEBUG:tasks.util.rgw: json result: {'id': 'ce8b804e-2a13-40d6-9daa-1ea26488fdaf', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0}}], 'realm_id': ''} 2021-07-26T15:36:38.648 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['user', 'list'] 2021-07-26T15:36:38.648 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'user', 'list'] 2021-07-26T15:36:38.648 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 user list 2021-07-26T15:36:38.683 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:36:38.684 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:36:38.702 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:38.696+0000 7fd33063f980 20 rados->read ofs=0 len=0 2021-07-26T15:36:39.836 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:39.840+0000 7fd33063f980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:36:39.837 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:39.840+0000 7fd33063f980 20 rados->read ofs=0 len=0 2021-07-26T15:36:39.844 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:39.848+0000 7fd33063f980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:36:39.844 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:39.848+0000 7fd33063f980 20 rados->read ofs=0 len=0 2021-07-26T15:36:39.845 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:39.848+0000 7fd33063f980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:36:39.846 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:39.848+0000 7fd33063f980 20 rados->read ofs=0 len=0 2021-07-26T15:36:39.846 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:39.848+0000 7fd33063f980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:36:39.858 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:39.860+0000 7fd33063f980 20 rados->read ofs=0 len=0 2021-07-26T15:36:39.860 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:39.860+0000 7fd33063f980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:36:39.861 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:39.860+0000 7fd33063f980 20 rados->read ofs=0 len=0 2021-07-26T15:36:39.861 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:39.860+0000 7fd33063f980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:36:39.862 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:39.860+0000 7fd33063f980 20 rados->read ofs=0 len=0 2021-07-26T15:36:39.863 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:39.860+0000 7fd33063f980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:36:39.863 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:39.860+0000 7fd33063f980 10 cannot find current period zonegroup using local zonegroup 2021-07-26T15:36:39.863 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:39.860+0000 7fd33063f980 20 rados->read ofs=0 len=0 2021-07-26T15:36:39.863 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:39.860+0000 7fd33063f980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:36:39.864 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:39.860+0000 7fd33063f980 20 rados->read ofs=0 len=0 2021-07-26T15:36:39.864 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:39.860+0000 7fd33063f980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:36:39.864 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:39.860+0000 7fd33063f980 10 Creating default zonegroup 2021-07-26T15:36:39.864 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:39.860+0000 7fd33063f980 20 get_system_obj_state: rctx=0x7ffe1a668f00 obj=:.pools.avail state=0x563ac82e7820 s->prefetch_data=0 2021-07-26T15:36:39.865 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:39.864+0000 7fd33063f980 10 couldn't find old data placement pools config, setting up new ones for the zone 2021-07-26T15:36:39.875 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:39.876+0000 7fd33063f980 10 WARNING: store->list_zones() returned r=-2 2021-07-26T15:36:39.876 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:39.876+0000 7fd33063f980 20 rados->read ofs=0 len=0 2021-07-26T15:36:39.876 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:39.876+0000 7fd33063f980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:36:39.880 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:39.880+0000 7fd33063f980 20 rados->read ofs=0 len=0 2021-07-26T15:36:39.880 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:39.880+0000 7fd33063f980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:36:39.880 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:39.880+0000 7fd33063f980 10 could not read realm id: (2) No such file or directory 2021-07-26T15:36:39.881 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:39.880+0000 7fd33063f980 10 WARNING: failed to set zone as default, r=-22 2021-07-26T15:36:39.881 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:39.880+0000 7fd33063f980 20 rados->read ofs=0 len=0 2021-07-26T15:36:39.881 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:39.884+0000 7fd33063f980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:36:39.886 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:39.888+0000 7fd33063f980 20 rados->read ofs=0 len=0 2021-07-26T15:36:39.886 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:39.888+0000 7fd33063f980 20 rados_obj.operate() r=0 bl.length=839 2021-07-26T15:36:39.886 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:39.888+0000 7fd33063f980 20 rados->read ofs=0 len=0 2021-07-26T15:36:39.889 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:39.888+0000 7fd33063f980 20 rados_obj.operate() r=0 bl.length=358 2021-07-26T15:36:39.889 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:39.888+0000 7fd33063f980 20 zonegroup default 2021-07-26T15:36:39.889 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:39.888+0000 7fd33063f980 20 rados->read ofs=0 len=0 2021-07-26T15:36:39.889 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:39.888+0000 7fd33063f980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:36:39.890 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:39.888+0000 7fd33063f980 10 Cannot find current period zone using local zone 2021-07-26T15:36:39.890 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:39.888+0000 7fd33063f980 10 Using default name default 2021-07-26T15:36:39.890 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:39.888+0000 7fd33063f980 20 rados->read ofs=0 len=0 2021-07-26T15:36:39.891 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:39.892+0000 7fd33063f980 20 rados_obj.operate() r=0 bl.length=46 2021-07-26T15:36:39.891 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:39.892+0000 7fd33063f980 20 rados->read ofs=0 len=0 2021-07-26T15:36:39.891 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:39.892+0000 7fd33063f980 20 rados_obj.operate() r=0 bl.length=839 2021-07-26T15:36:39.891 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:39.892+0000 7fd33063f980 20 zone default found 2021-07-26T15:36:39.892 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:39.892+0000 7fd33063f980 20 rados->read ofs=0 len=0 2021-07-26T15:36:41.867 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:41.867+0000 7fd33063f980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:36:41.867 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:41.867+0000 7fd33063f980 20 rados->read ofs=0 len=0 2021-07-26T15:36:41.868 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:41.867+0000 7fd33063f980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:36:41.873 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:41.867+0000 7fd33063f980 20 started sync module instance, tier type = 2021-07-26T15:36:41.873 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:41.867+0000 7fd33063f980 20 started zone id=a9b606c3-79dc-4b9b-a53d-97553f5ac70c (name=default) with tier type = 2021-07-26T15:36:43.898 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:43.898+0000 7fd33063f980 20 add_watcher() i=0 2021-07-26T15:36:43.899 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:43.898+0000 7fd33063f980 20 add_watcher() i=1 2021-07-26T15:36:43.899 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:43.898+0000 7fd33063f980 20 add_watcher() i=2 2021-07-26T15:36:43.899 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:43.898+0000 7fd33063f980 20 add_watcher() i=3 2021-07-26T15:36:43.899 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:43.898+0000 7fd33063f980 20 add_watcher() i=4 2021-07-26T15:36:43.899 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:43.898+0000 7fd33063f980 20 add_watcher() i=5 2021-07-26T15:36:43.900 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:43.898+0000 7fd33063f980 20 add_watcher() i=6 2021-07-26T15:36:43.901 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:43.898+0000 7fd33063f980 20 add_watcher() i=7 2021-07-26T15:36:43.901 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:43.898+0000 7fd33063f980 2 all 8 watchers are set, enabling cache 2021-07-26T15:36:43.901 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:43.898+0000 7fd33063f980 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2021-07-26T15:36:43.901 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:43.898+0000 7fd33063f980 20 check_secure_mon_conn(): mode 1 is insecure 2021-07-26T15:36:43.902 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:43.898+0000 7fd2ff7de700 2 RGWDataChangesLog::ChangesRenewThread: start 2021-07-26T15:36:47.898 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:47.896+0000 7fd33063f980 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2021-07-26T15:36:47.999 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:47.996+0000 7fd26dffb700 20 reqs_thread_entry: start 2021-07-26T15:36:47.999 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:47.996+0000 7fd25b7fe700 20 reqs_thread_entry: start 2021-07-26T15:36:47.999 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:47.996+0000 7fd33063f980 20 init_complete bucket index max shards: 11 2021-07-26T15:36:48.000 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.000+0000 7fd259ffb700 20 reqs_thread_entry: start 2021-07-26T15:36:48.024 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.024+0000 7fd2ff7de700 2 RGWDataChangesLog::ChangesRenewThread: start 2021-07-26T15:36:48.026 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.024+0000 7fd33063f980 20 remove_watcher() i=0 2021-07-26T15:36:48.026 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.024+0000 7fd33063f980 2 removed watcher, disabling cache 2021-07-26T15:36:48.028 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.028+0000 7fd33063f980 20 remove_watcher() i=1 2021-07-26T15:36:48.030 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.028+0000 7fd33063f980 20 remove_watcher() i=2 2021-07-26T15:36:48.033 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.032+0000 7fd33063f980 20 remove_watcher() i=3 2021-07-26T15:36:48.035 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.036+0000 7fd33063f980 20 remove_watcher() i=4 2021-07-26T15:36:48.037 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.036+0000 7fd33063f980 20 remove_watcher() i=5 2021-07-26T15:36:48.040 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.040+0000 7fd33063f980 20 remove_watcher() i=6 2021-07-26T15:36:48.042 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.040+0000 7fd33063f980 20 remove_watcher() i=7 2021-07-26T15:36:48.052 INFO:teuthology.orchestra.run.smithi197.stdout:[] 2021-07-26T15:36:48.052 DEBUG:tasks.util.rgw: json result: [] 2021-07-26T15:36:48.053 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2021-07-26T15:36:48.053 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2021-07-26T15:36:48.054 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone placement modify --rgw-zone default --placement-id default-placement --compression random 2021-07-26T15:36:48.133 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:36:48.133 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:36:48.147 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.144+0000 7f481fe10980 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2021-07-26T15:36:48.147 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.144+0000 7f481fe10980 20 check_secure_mon_conn(): mode 1 is insecure 2021-07-26T15:36:48.154 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.152+0000 7f47667fc700 20 reqs_thread_entry: start 2021-07-26T15:36:48.154 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.152+0000 7f481fe10980 20 rados->read ofs=0 len=0 2021-07-26T15:36:48.155 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.152+0000 7f481fe10980 20 rados_obj.operate() r=0 bl.length=46 2021-07-26T15:36:48.155 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.152+0000 7f481fe10980 20 rados->read ofs=0 len=0 2021-07-26T15:36:48.158 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.156+0000 7f481fe10980 20 rados_obj.operate() r=0 bl.length=839 2021-07-26T15:36:48.158 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.156+0000 7f481fe10980 20 rados->read ofs=0 len=0 2021-07-26T15:36:48.159 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.156+0000 7f481fe10980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:36:48.159 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.156+0000 7f481fe10980 20 rados->read ofs=0 len=0 2021-07-26T15:36:48.160 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.156+0000 7f481fe10980 20 rados_obj.operate() r=0 bl.length=46 2021-07-26T15:36:48.160 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.156+0000 7f481fe10980 20 rados->read ofs=0 len=0 2021-07-26T15:36:48.161 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.156+0000 7f481fe10980 20 rados_obj.operate() r=0 bl.length=358 2021-07-26T15:36:48.168 INFO:teuthology.orchestra.run.smithi197.stdout:{"id":"a9b606c3-79dc-4b9b-a53d-97553f5ac70c","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0}}],"realm_id":""} 2021-07-26T15:36:48.169 DEBUG:tasks.util.rgw: json result: {'id': 'a9b606c3-79dc-4b9b-a53d-97553f5ac70c', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0}}], 'realm_id': ''} 2021-07-26T15:36:48.170 INFO:tasks.util.rgw:rgwadmin: c2.client.1 : ['user', 'list'] 2021-07-26T15:36:48.170 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.1', '--cluster', 'c2', 'user', 'list'] 2021-07-26T15:36:48.171 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.1 --cluster c2 user list 2021-07-26T15:36:48.205 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:36:48.206 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:36:48.218 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.216+0000 7fdc2f08c980 20 rados->read ofs=0 len=0 2021-07-26T15:36:48.221 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.220+0000 7fdc2f08c980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:36:48.221 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.220+0000 7fdc2f08c980 20 rados->read ofs=0 len=0 2021-07-26T15:36:48.222 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.220+0000 7fdc2f08c980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:36:48.222 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.220+0000 7fdc2f08c980 20 rados->read ofs=0 len=0 2021-07-26T15:36:48.223 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.220+0000 7fdc2f08c980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:36:48.223 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.220+0000 7fdc2f08c980 20 rados->read ofs=0 len=0 2021-07-26T15:36:48.224 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.220+0000 7fdc2f08c980 20 rados_obj.operate() r=0 bl.length=46 2021-07-26T15:36:48.242 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.240+0000 7fdc2f08c980 20 RGWRados::pool_iterate: got zonegroup_info.ffd0f5ed-266c-4900-864f-c18c79040de3 2021-07-26T15:36:48.242 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.240+0000 7fdc2f08c980 20 RGWRados::pool_iterate: got zone_info.a9b606c3-79dc-4b9b-a53d-97553f5ac70c 2021-07-26T15:36:48.243 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.240+0000 7fdc2f08c980 20 RGWRados::pool_iterate: got zone_names.default 2021-07-26T15:36:48.244 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.240+0000 7fdc2f08c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2021-07-26T15:36:48.244 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.240+0000 7fdc2f08c980 20 rados->read ofs=0 len=0 2021-07-26T15:36:48.247 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.240+0000 7fdc2f08c980 20 rados_obj.operate() r=0 bl.length=46 2021-07-26T15:36:48.247 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.240+0000 7fdc2f08c980 20 rados->read ofs=0 len=0 2021-07-26T15:36:48.248 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.240+0000 7fdc2f08c980 20 rados_obj.operate() r=0 bl.length=855 2021-07-26T15:36:48.248 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.240+0000 7fdc2f08c980 20 rados->read ofs=0 len=0 2021-07-26T15:36:48.250 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.244+0000 7fdc2f08c980 20 rados_obj.operate() r=0 bl.length=46 2021-07-26T15:36:48.250 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.244+0000 7fdc2f08c980 20 rados->read ofs=0 len=0 2021-07-26T15:36:48.251 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.244+0000 7fdc2f08c980 20 rados_obj.operate() r=0 bl.length=358 2021-07-26T15:36:48.251 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.244+0000 7fdc2f08c980 20 rados->read ofs=0 len=0 2021-07-26T15:36:48.251 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.244+0000 7fdc2f08c980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:36:48.251 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.244+0000 7fdc2f08c980 10 cannot find current period zonegroup using local zonegroup 2021-07-26T15:36:48.252 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.244+0000 7fdc2f08c980 20 rados->read ofs=0 len=0 2021-07-26T15:36:48.252 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.244+0000 7fdc2f08c980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:36:48.252 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.244+0000 7fdc2f08c980 20 rados->read ofs=0 len=0 2021-07-26T15:36:48.258 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.244+0000 7fdc2f08c980 20 rados_obj.operate() r=0 bl.length=46 2021-07-26T15:36:48.259 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.244+0000 7fdc2f08c980 20 rados->read ofs=0 len=0 2021-07-26T15:36:48.259 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.244+0000 7fdc2f08c980 20 rados_obj.operate() r=0 bl.length=358 2021-07-26T15:36:48.259 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.244+0000 7fdc2f08c980 20 zonegroup default 2021-07-26T15:36:48.260 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.244+0000 7fdc2f08c980 20 rados->read ofs=0 len=0 2021-07-26T15:36:48.260 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.248+0000 7fdc2f08c980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:36:48.260 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.248+0000 7fdc2f08c980 10 Cannot find current period zone using local zone 2021-07-26T15:36:48.260 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.248+0000 7fdc2f08c980 20 rados->read ofs=0 len=0 2021-07-26T15:36:48.261 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.248+0000 7fdc2f08c980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:36:48.261 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.248+0000 7fdc2f08c980 20 rados->read ofs=0 len=0 2021-07-26T15:36:48.262 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.248+0000 7fdc2f08c980 20 rados_obj.operate() r=0 bl.length=46 2021-07-26T15:36:48.262 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.248+0000 7fdc2f08c980 20 rados->read ofs=0 len=0 2021-07-26T15:36:48.262 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.248+0000 7fdc2f08c980 20 rados_obj.operate() r=0 bl.length=855 2021-07-26T15:36:48.263 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.248+0000 7fdc2f08c980 20 zone default found 2021-07-26T15:36:48.263 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.248+0000 7fdc2f08c980 20 rados->read ofs=0 len=0 2021-07-26T15:36:48.264 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.248+0000 7fdc2f08c980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:36:48.264 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.248+0000 7fdc2f08c980 20 rados->read ofs=0 len=0 2021-07-26T15:36:48.264 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.248+0000 7fdc2f08c980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:36:48.264 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.248+0000 7fdc2f08c980 20 started sync module instance, tier type = 2021-07-26T15:36:48.265 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.248+0000 7fdc2f08c980 20 started zone id=a9b606c3-79dc-4b9b-a53d-97553f5ac70c (name=default) with tier type = 2021-07-26T15:36:48.274 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.272+0000 7fdc2f08c980 20 add_watcher() i=0 2021-07-26T15:36:48.274 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.272+0000 7fdc2f08c980 20 add_watcher() i=1 2021-07-26T15:36:48.274 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.272+0000 7fdc2f08c980 20 add_watcher() i=2 2021-07-26T15:36:48.274 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.272+0000 7fdc2f08c980 20 add_watcher() i=3 2021-07-26T15:36:48.275 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.272+0000 7fdc2f08c980 20 add_watcher() i=4 2021-07-26T15:36:48.275 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.272+0000 7fdc2f08c980 20 add_watcher() i=5 2021-07-26T15:36:48.275 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.272+0000 7fdc2f08c980 20 add_watcher() i=6 2021-07-26T15:36:48.276 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.272+0000 7fdc2f08c980 20 add_watcher() i=7 2021-07-26T15:36:48.276 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.276+0000 7fdc2f08c980 2 all 8 watchers are set, enabling cache 2021-07-26T15:36:48.277 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.276+0000 7fdc2f08c980 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2021-07-26T15:36:48.277 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.276+0000 7fdc2f08c980 20 check_secure_mon_conn(): mode 1 is insecure 2021-07-26T15:36:48.277 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.276+0000 7fdbfd7e2700 2 RGWDataChangesLog::ChangesRenewThread: start 2021-07-26T15:36:48.358 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.356+0000 7fdb6f7fe700 20 reqs_thread_entry: start 2021-07-26T15:36:48.359 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.356+0000 7fdc2f08c980 20 init_complete bucket index max shards: 11 2021-07-26T15:36:48.359 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.356+0000 7fdb6d7fa700 20 reqs_thread_entry: start 2021-07-26T15:36:48.361 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.356+0000 7fdb5b7fe700 20 reqs_thread_entry: start 2021-07-26T15:36:48.383 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.380+0000 7fdbfd7e2700 2 RGWDataChangesLog::ChangesRenewThread: start 2021-07-26T15:36:48.385 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.384+0000 7fdc2f08c980 20 remove_watcher() i=0 2021-07-26T15:36:48.386 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.384+0000 7fdc2f08c980 2 removed watcher, disabling cache 2021-07-26T15:36:48.388 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.388+0000 7fdc2f08c980 20 remove_watcher() i=1 2021-07-26T15:36:48.390 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.388+0000 7fdc2f08c980 20 remove_watcher() i=2 2021-07-26T15:36:48.392 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.392+0000 7fdc2f08c980 20 remove_watcher() i=3 2021-07-26T15:36:48.395 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.392+0000 7fdc2f08c980 20 remove_watcher() i=4 2021-07-26T15:36:48.397 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.396+0000 7fdc2f08c980 20 remove_watcher() i=5 2021-07-26T15:36:48.400 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.400+0000 7fdc2f08c980 20 remove_watcher() i=6 2021-07-26T15:36:48.403 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.400+0000 7fdc2f08c980 20 remove_watcher() i=7 2021-07-26T15:36:48.409 INFO:teuthology.orchestra.run.smithi197.stdout:[] 2021-07-26T15:36:48.410 DEBUG:tasks.util.rgw: json result: [] 2021-07-26T15:36:48.410 INFO:tasks.util.rgw:rgwadmin: c2.client.1 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2021-07-26T15:36:48.411 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.1', '--cluster', 'c2', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2021-07-26T15:36:48.411 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.1 --cluster c2 zone placement modify --rgw-zone default --placement-id default-placement --compression random 2021-07-26T15:36:48.489 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:36:48.489 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:36:48.501 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.500+0000 7f7fd38de980 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2021-07-26T15:36:48.501 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.500+0000 7f7fd38de980 20 check_secure_mon_conn(): mode 1 is insecure 2021-07-26T15:36:48.506 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.504+0000 7f7fd38de980 20 rados->read ofs=0 len=0 2021-07-26T15:36:48.507 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.504+0000 7f7f497fa700 20 reqs_thread_entry: start 2021-07-26T15:36:48.509 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.508+0000 7f7fd38de980 20 rados_obj.operate() r=0 bl.length=46 2021-07-26T15:36:48.509 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.508+0000 7f7fd38de980 20 rados->read ofs=0 len=0 2021-07-26T15:36:48.510 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.508+0000 7f7fd38de980 20 rados_obj.operate() r=0 bl.length=855 2021-07-26T15:36:48.510 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.508+0000 7f7fd38de980 20 rados->read ofs=0 len=0 2021-07-26T15:36:48.511 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.508+0000 7f7fd38de980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:36:48.511 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.508+0000 7f7fd38de980 20 rados->read ofs=0 len=0 2021-07-26T15:36:48.512 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.508+0000 7f7fd38de980 20 rados_obj.operate() r=0 bl.length=46 2021-07-26T15:36:48.513 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.508+0000 7f7fd38de980 20 rados->read ofs=0 len=0 2021-07-26T15:36:48.513 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:36:48.512+0000 7f7fd38de980 20 rados_obj.operate() r=0 bl.length=358 2021-07-26T15:36:48.523 INFO:teuthology.orchestra.run.smithi197.stdout:{"id":"a9b606c3-79dc-4b9b-a53d-97553f5ac70c","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0}}],"realm_id":""} 2021-07-26T15:36:48.523 DEBUG:tasks.util.rgw: json result: {'id': 'a9b606c3-79dc-4b9b-a53d-97553f5ac70c', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0}}], 'realm_id': ''} 2021-07-26T15:36:48.524 INFO:tasks.rgw:Starting rgw... 2021-07-26T15:36:48.524 INFO:tasks.rgw:rgw c1.client.0 config is {'port': 8000} 2021-07-26T15:36:48.525 INFO:tasks.rgw:Using beast as radosgw frontend 2021-07-26T15:36:48.525 INFO:tasks.rgw.c1.client.0:Restarting daemon 2021-07-26T15:36:48.526 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c1 -k /etc/ceph/c1.client.0.keyring --log-file /var/log/ceph/rgw.c1.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c1.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.c1.client.0.stdout 2>&1 2021-07-26T15:36:48.529 INFO:tasks.rgw.c1.client.0:Started 2021-07-26T15:36:48.530 INFO:tasks.rgw:rgw c2.client.0 config is {'port': 8000} 2021-07-26T15:36:48.530 INFO:tasks.rgw:Using beast as radosgw frontend 2021-07-26T15:36:48.530 INFO:tasks.rgw.c2.client.0:Restarting daemon 2021-07-26T15:36:48.531 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.c2.client.0.stdout 2>&1 2021-07-26T15:36:48.534 INFO:tasks.rgw.c2.client.0:Started 2021-07-26T15:36:48.534 INFO:tasks.rgw:rgw c2.client.1 config is {'port': 8001} 2021-07-26T15:36:48.534 INFO:tasks.rgw:Using beast as radosgw frontend 2021-07-26T15:36:48.535 INFO:tasks.rgw.c2.client.1:Restarting daemon 2021-07-26T15:36:48.535 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8001' -n client.1 --cluster c2 -k /etc/ceph/c2.client.1.keyring --log-file /var/log/ceph/rgw.c2.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.1.sock --foreground | sudo tee /var/log/ceph/rgw.c2.client.1.stdout 2>&1 2021-07-26T15:36:48.538 INFO:tasks.rgw.c2.client.1:Started 2021-07-26T15:36:48.538 INFO:tasks.rgw:Polling c1.client.0 until it starts accepting connections on http://smithi183.front.sepia.ceph.com:8000/ 2021-07-26T15:36:48.538 DEBUG:teuthology.orchestra.run.smithi183:> curl http://smithi183.front.sepia.ceph.com:8000/ 2021-07-26T15:36:48.569 INFO:teuthology.orchestra.run.smithi183.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-07-26T15:36:48.569 INFO:teuthology.orchestra.run.smithi183.stderr: Dload Upload Total Spent Left Speed 2021-07-26T15:36:48.571 DEBUG:teuthology.orchestra.run:got remote process result: 7 2021-07-26T15:36:48.572 INFO:teuthology.orchestra.run.smithi183.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2021-07-26T15:36:48.573 INFO:teuthology.orchestra.run.smithi183.stderr:curl: (7) Failed to connect to smithi183.front.sepia.ceph.com port 8000: Connection refused 2021-07-26T15:36:49.574 DEBUG:teuthology.orchestra.run.smithi183:> curl http://smithi183.front.sepia.ceph.com:8000/ 2021-07-26T15:36:49.591 INFO:teuthology.orchestra.run.smithi183.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-07-26T15:36:49.592 INFO:teuthology.orchestra.run.smithi183.stderr: Dload Upload Total Spent Left Speed 2021-07-26T15:36:49.594 INFO:teuthology.orchestra.run.smithi183.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 104k 0 --:--:-- --:--:-- --:--:-- 104k 2021-07-26T15:36:49.595 INFO:teuthology.orchestra.run.smithi183.stdout:anonymous 2021-07-26T15:36:49.596 INFO:tasks.rgw:Polling c2.client.0 until it starts accepting connections on http://smithi197.front.sepia.ceph.com:8000/ 2021-07-26T15:36:49.596 DEBUG:teuthology.orchestra.run.smithi197:> curl http://smithi197.front.sepia.ceph.com:8000/ 2021-07-26T15:36:49.627 INFO:teuthology.orchestra.run.smithi197.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-07-26T15:36:49.627 INFO:teuthology.orchestra.run.smithi197.stderr: Dload Upload Total Spent Left Speed 2021-07-26T15:36:49.628 INFO:teuthology.orchestra.run.smithi197.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 208k 0 --:--:-- --:--:-- --:--:-- 208k 2021-07-26T15:36:49.629 INFO:teuthology.orchestra.run.smithi197.stdout:anonymous 2021-07-26T15:36:49.629 INFO:tasks.rgw:Polling c2.client.1 until it starts accepting connections on http://smithi197.front.sepia.ceph.com:8001/ 2021-07-26T15:36:49.630 DEBUG:teuthology.orchestra.run.smithi197:> curl http://smithi197.front.sepia.ceph.com:8001/ 2021-07-26T15:36:49.687 INFO:teuthology.orchestra.run.smithi197.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-07-26T15:36:49.687 INFO:teuthology.orchestra.run.smithi197.stderr: Dload Upload Total Spent Left Speed 2021-07-26T15:36:49.688 INFO:teuthology.orchestra.run.smithi197.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 208k 0 --:--:-- --:--:-- --:--:-- 208k 2021-07-26T15:36:49.689 INFO:teuthology.orchestra.run.smithi197.stdout:anonymous 2021-07-26T15:36:49.690 INFO:teuthology.run_tasks:Running task rgw-multisite... 2021-07-26T15:36:50.143 INFO:tasks.rgw_multisite:creating realm.. 2021-07-26T15:36:50.144 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['realm', 'create', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:36:50.145 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'realm', 'create', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:36:50.145 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 realm create --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:36:50.180 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:36:50.182 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:36:50.231 INFO:teuthology.orchestra.run.smithi183.stdout:{"id":"d1743e17-c3cb-4823-84fd-b11c05487344","name":"test-realm","current_period":"020d7ea2-e91f-4b2e-a208-89d15bc5931e","epoch":1} 2021-07-26T15:36:50.232 INFO:tasks.rgw_multisite:creating master zonegroup.. 2021-07-26T15:36:50.232 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zonegroup', 'set', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:36:50.233 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zonegroup', 'set', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:36:50.233 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zonegroup set --rgw-zonegroup test-zonegroup --rgw-realm test-realm --default --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:36:50.309 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:36:50.310 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:36:50.332 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:36:50.330+0000 7fb4308eb980 -1 old format 2021-07-26T15:36:50.346 INFO:teuthology.orchestra.run.smithi183.stdout:{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://smithi183.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"","zones":[],"placement_targets":[],"default_placement":"","realm_id":"d1743e17-c3cb-4823-84fd-b11c05487344","sync_policy":{"groups":[]}} 2021-07-26T15:36:50.346 INFO:tasks.rgw_multisite:creating master zone.. 2021-07-26T15:36:50.347 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'create', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--master', '--access-key', 'ZVEPLG55FHAYZUFC', '--secret', 'fSeMFeFOakj53SxFrtZZrsnDzPpkESXF', '--endpoints', 'http://smithi183.front.sepia.ceph.com:8000', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:36:50.347 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'create', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--master', '--access-key', 'ZVEPLG55FHAYZUFC', '--secret', 'fSeMFeFOakj53SxFrtZZrsnDzPpkESXF', '--endpoints', 'http://smithi183.front.sepia.ceph.com:8000', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:36:50.348 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone create --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --default --master --access-key ZVEPLG55FHAYZUFC --secret fSeMFeFOakj53SxFrtZZrsnDzPpkESXF --endpoints http://smithi183.front.sepia.ceph.com:8000 --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:36:50.394 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:36:50.395 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:36:50.455 INFO:teuthology.orchestra.run.smithi183.stdout:{"id":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe","name":"test-zone1","domain_root":"test-zone1.rgw.meta:root","control_pool":"test-zone1.rgw.control","gc_pool":"test-zone1.rgw.log:gc","lc_pool":"test-zone1.rgw.log:lc","log_pool":"test-zone1.rgw.log","intent_log_pool":"test-zone1.rgw.log:intent","usage_log_pool":"test-zone1.rgw.log:usage","roles_pool":"test-zone1.rgw.meta:roles","reshard_pool":"test-zone1.rgw.log:reshard","user_keys_pool":"test-zone1.rgw.meta:users.keys","user_email_pool":"test-zone1.rgw.meta:users.email","user_swift_pool":"test-zone1.rgw.meta:users.swift","user_uid_pool":"test-zone1.rgw.meta:users.uid","otp_pool":"test-zone1.rgw.otp","system_key":{"access_key":"ZVEPLG55FHAYZUFC","secret_key":"fSeMFeFOakj53SxFrtZZrsnDzPpkESXF"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone1.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone1.rgw.buckets.data"}},"data_extra_pool":"test-zone1.rgw.buckets.non-ec","index_type":0}}],"realm_id":"d1743e17-c3cb-4823-84fd-b11c05487344"} 2021-07-26T15:36:50.457 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph osd pool create test-zone1.rgw.buckets.data 64 64 --cluster c1 2021-07-26T15:36:51.408 INFO:teuthology.orchestra.run.smithi183.stderr:pool 'test-zone1.rgw.buckets.data' created 2021-07-26T15:36:51.423 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph osd pool application enable test-zone1.rgw.buckets.data rgw --cluster c1 2021-07-26T15:36:52.433 INFO:teuthology.orchestra.run.smithi183.stderr:enabled application 'rgw' on pool 'test-zone1.rgw.buckets.data' 2021-07-26T15:36:52.452 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'placement', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:36:52.452 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'placement', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:36:52.453 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone placement --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm modify --placement-id default-placement --compression random --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:36:52.486 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:36:52.486 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:36:52.512 INFO:teuthology.orchestra.run.smithi183.stdout:{"id":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe","name":"test-zone1","domain_root":"test-zone1.rgw.meta:root","control_pool":"test-zone1.rgw.control","gc_pool":"test-zone1.rgw.log:gc","lc_pool":"test-zone1.rgw.log:lc","log_pool":"test-zone1.rgw.log","intent_log_pool":"test-zone1.rgw.log:intent","usage_log_pool":"test-zone1.rgw.log:usage","roles_pool":"test-zone1.rgw.meta:roles","reshard_pool":"test-zone1.rgw.log:reshard","user_keys_pool":"test-zone1.rgw.meta:users.keys","user_email_pool":"test-zone1.rgw.meta:users.email","user_swift_pool":"test-zone1.rgw.meta:users.swift","user_uid_pool":"test-zone1.rgw.meta:users.uid","otp_pool":"test-zone1.rgw.otp","system_key":{"access_key":"ZVEPLG55FHAYZUFC","secret_key":"fSeMFeFOakj53SxFrtZZrsnDzPpkESXF"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone1.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone1.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone1.rgw.buckets.non-ec","index_type":0}}],"realm_id":""} 2021-07-26T15:36:52.513 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:36:52.513 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:36:52.514 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 period update --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:36:52.588 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:36:52.588 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:37:00.663 INFO:teuthology.orchestra.run.smithi183.stdout:{"id":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","epoch":1,"predecessor_uuid":"020d7ea2-e91f-4b2e-a208-89d15bc5931e","sync_status":[],"period_map":{"id":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://smithi183.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe","zones":[{"id":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe","name":"test-zone1","endpoints":["http://smithi183.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"false","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"d1743e17-c3cb-4823-84fd-b11c05487344","sync_policy":{"groups":[]}}],"short_zone_ids":[{"key":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe","val":2260121961}]},"master_zonegroup":"test-zonegroup","master_zone":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"d1743e17-c3cb-4823-84fd-b11c05487344","realm_name":"test-realm","realm_epoch":2} 2021-07-26T15:37:00.663 DEBUG:tasks.rgw.c1.client.0:waiting for process to exit 2021-07-26T15:37:00.664 INFO:teuthology.orchestra.run:waiting for 300 2021-07-26T15:37:00.665 INFO:tasks.rgw.c1.client.0.smithi183.stdout:2021-07-26T15:37:00.663+0000 7f87ed855700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=8000 -n client.0 --cluster c1 -k /etc/ceph/c1.client.0.keyring --log-file /var/log/ceph/rgw.c1.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c1.client.0.sock --foreground (PID: 15921) UID: 0 2021-07-26T15:37:00.665 INFO:tasks.rgw.c1.client.0.smithi183.stdout:2021-07-26T15:37:00.663+0000 7f87f1c2f980 -1 shutting down 2021-07-26T15:37:01.860 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c1.rgw.client.0 is failed for ~0s 2021-07-26T15:37:06.766 INFO:tasks.rgw.c1.client.0:Stopped 2021-07-26T15:37:06.767 INFO:tasks.rgw.c1.client.0:Restarting daemon 2021-07-26T15:37:06.767 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c1 -k /etc/ceph/c1.client.0.keyring --log-file /var/log/ceph/rgw.c1.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c1.client.0.sock --foreground --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c1.client.0.stdout 2>&1 2021-07-26T15:37:06.771 INFO:tasks.rgw.c1.client.0:Started 2021-07-26T15:37:06.771 DEBUG:teuthology.orchestra.run.smithi183:> curl http://smithi183.front.sepia.ceph.com:8000 2021-07-26T15:37:06.791 INFO:teuthology.orchestra.run.smithi183.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-07-26T15:37:06.792 INFO:teuthology.orchestra.run.smithi183.stderr: Dload Upload Total Spent Left Speed 2021-07-26T15:37:06.792 INFO:teuthology.orchestra.run.smithi183.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2021-07-26T15:37:06.792 INFO:teuthology.orchestra.run.smithi183.stderr:curl: (7) Failed to connect to smithi183.front.sepia.ceph.com port 8000: Connection refused 2021-07-26T15:37:06.793 DEBUG:teuthology.orchestra.run:got remote process result: 7 2021-07-26T15:37:07.465 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c1.rgw.client.0 has been restored 2021-07-26T15:37:07.795 DEBUG:teuthology.orchestra.run.smithi183:> curl http://smithi183.front.sepia.ceph.com:8000 2021-07-26T15:37:07.814 INFO:teuthology.orchestra.run.smithi183.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-07-26T15:37:07.814 INFO:teuthology.orchestra.run.smithi183.stderr: Dload Upload Total Spent Left Speed 2021-07-26T15:37:07.830 INFO:teuthology.orchestra.run.smithi183.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 13375 0 --:--:-- --:--:-- --:--:-- 14266 2021-07-26T15:37:07.830 INFO:teuthology.orchestra.run.smithi183.stdout:anonymous 2021-07-26T15:37:07.831 INFO:tasks.rgw_multisite:creating admin user.. 2021-07-26T15:37:07.831 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['user', 'create', '--uid', 'realm-admin', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--display-name', 'Realm Admin', '--system', '--access-key', 'ZVEPLG55FHAYZUFC', '--secret', 'fSeMFeFOakj53SxFrtZZrsnDzPpkESXF', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:37:07.832 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'user', 'create', '--uid', 'realm-admin', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--display-name', 'Realm Admin', '--system', '--access-key', 'ZVEPLG55FHAYZUFC', '--secret', 'fSeMFeFOakj53SxFrtZZrsnDzPpkESXF', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:37:07.833 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 user create --uid realm-admin --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --display-name 'Realm Admin' --system --access-key ZVEPLG55FHAYZUFC --secret fSeMFeFOakj53SxFrtZZrsnDzPpkESXF --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:37:07.879 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:37:07.880 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:37:08.057 INFO:teuthology.orchestra.run.smithi183.stdout:{"user_id":"realm-admin","display_name":"Realm Admin","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"realm-admin","access_key":"ZVEPLG55FHAYZUFC","secret_key":"fSeMFeFOakj53SxFrtZZrsnDzPpkESXF"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","system":"true","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2021-07-26T15:37:08.085 INFO:tasks.rgw_multisite:pulling realm configuration to c2 2021-07-26T15:37:08.085 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['realm', 'pull', '--rgw-realm', 'test-realm', '--url', 'http://smithi183.front.sepia.ceph.com:8000', '--access-key', 'ZVEPLG55FHAYZUFC', '--secret', 'fSeMFeFOakj53SxFrtZZrsnDzPpkESXF', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:37:08.086 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'realm', 'pull', '--rgw-realm', 'test-realm', '--url', 'http://smithi183.front.sepia.ceph.com:8000', '--access-key', 'ZVEPLG55FHAYZUFC', '--secret', 'fSeMFeFOakj53SxFrtZZrsnDzPpkESXF', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:37:08.086 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 realm pull --rgw-realm test-realm --url http://smithi183.front.sepia.ceph.com:8000 --access-key ZVEPLG55FHAYZUFC --secret fSeMFeFOakj53SxFrtZZrsnDzPpkESXF --cluster c2 --debug-rgw 0 --debug-ms 0 2021-07-26T15:37:08.128 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:37:08.128 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:37:08.194 INFO:teuthology.orchestra.run.smithi197.stdout:{"id":"d1743e17-c3cb-4823-84fd-b11c05487344","name":"test-realm","current_period":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","epoch":2} 2021-07-26T15:37:08.195 INFO:tasks.rgw_multisite:creating zone.. 2021-07-26T15:37:08.195 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'create', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--access-key', 'ZVEPLG55FHAYZUFC', '--secret', 'fSeMFeFOakj53SxFrtZZrsnDzPpkESXF', '--endpoints', 'http://smithi197.front.sepia.ceph.com:8000', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:37:08.196 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'create', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--access-key', 'ZVEPLG55FHAYZUFC', '--secret', 'fSeMFeFOakj53SxFrtZZrsnDzPpkESXF', '--endpoints', 'http://smithi197.front.sepia.ceph.com:8000', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:37:08.196 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone create --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --default --access-key ZVEPLG55FHAYZUFC --secret fSeMFeFOakj53SxFrtZZrsnDzPpkESXF --endpoints http://smithi197.front.sepia.ceph.com:8000 --cluster c2 --debug-rgw 0 --debug-ms 0 2021-07-26T15:37:08.279 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:37:08.279 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:37:08.335 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:37:08.330+0000 7f4168e7e980 0 failed reading obj info from .rgw.root:zone_info.fdbd535a-3fb6-49cb-8b49-68faf14e40fe: (2) No such file or directory 2021-07-26T15:37:08.335 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:37:08.330+0000 7f4168e7e980 0 WARNING: could not read zone params for zone id=fdbd535a-3fb6-49cb-8b49-68faf14e40fe name=test-zone1 2021-07-26T15:37:08.349 INFO:teuthology.orchestra.run.smithi197.stdout:{"id":"1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d","name":"test-zone2","domain_root":"test-zone2.rgw.meta:root","control_pool":"test-zone2.rgw.control","gc_pool":"test-zone2.rgw.log:gc","lc_pool":"test-zone2.rgw.log:lc","log_pool":"test-zone2.rgw.log","intent_log_pool":"test-zone2.rgw.log:intent","usage_log_pool":"test-zone2.rgw.log:usage","roles_pool":"test-zone2.rgw.meta:roles","reshard_pool":"test-zone2.rgw.log:reshard","user_keys_pool":"test-zone2.rgw.meta:users.keys","user_email_pool":"test-zone2.rgw.meta:users.email","user_swift_pool":"test-zone2.rgw.meta:users.swift","user_uid_pool":"test-zone2.rgw.meta:users.uid","otp_pool":"test-zone2.rgw.otp","system_key":{"access_key":"ZVEPLG55FHAYZUFC","secret_key":"fSeMFeFOakj53SxFrtZZrsnDzPpkESXF"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone2.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone2.rgw.buckets.data"}},"data_extra_pool":"test-zone2.rgw.buckets.non-ec","index_type":0}}],"realm_id":"d1743e17-c3cb-4823-84fd-b11c05487344"} 2021-07-26T15:37:08.349 DEBUG:teuthology.orchestra.run.smithi197:> sudo ceph osd pool create test-zone2.rgw.buckets.data 64 64 --cluster c2 2021-07-26T15:37:08.715 INFO:teuthology.orchestra.run.smithi197.stderr:pool 'test-zone2.rgw.buckets.data' created 2021-07-26T15:37:08.729 DEBUG:teuthology.orchestra.run.smithi197:> sudo ceph osd pool application enable test-zone2.rgw.buckets.data rgw --cluster c2 2021-07-26T15:37:09.747 INFO:teuthology.orchestra.run.smithi197.stderr:enabled application 'rgw' on pool 'test-zone2.rgw.buckets.data' 2021-07-26T15:37:09.764 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'placement', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:37:09.765 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'placement', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:37:09.765 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone placement --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm modify --placement-id default-placement --compression random --cluster c2 --debug-rgw 0 --debug-ms 0 2021-07-26T15:37:09.799 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:37:09.799 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:37:09.828 INFO:teuthology.orchestra.run.smithi197.stdout:{"id":"1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d","name":"test-zone2","domain_root":"test-zone2.rgw.meta:root","control_pool":"test-zone2.rgw.control","gc_pool":"test-zone2.rgw.log:gc","lc_pool":"test-zone2.rgw.log:lc","log_pool":"test-zone2.rgw.log","intent_log_pool":"test-zone2.rgw.log:intent","usage_log_pool":"test-zone2.rgw.log:usage","roles_pool":"test-zone2.rgw.meta:roles","reshard_pool":"test-zone2.rgw.log:reshard","user_keys_pool":"test-zone2.rgw.meta:users.keys","user_email_pool":"test-zone2.rgw.meta:users.email","user_swift_pool":"test-zone2.rgw.meta:users.swift","user_uid_pool":"test-zone2.rgw.meta:users.uid","otp_pool":"test-zone2.rgw.otp","system_key":{"access_key":"ZVEPLG55FHAYZUFC","secret_key":"fSeMFeFOakj53SxFrtZZrsnDzPpkESXF"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone2.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone2.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone2.rgw.buckets.non-ec","index_type":0}}],"realm_id":""} 2021-07-26T15:37:09.829 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:37:09.829 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:37:09.830 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2021-07-26T15:37:09.911 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:37:09.912 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:37:17.899 INFO:teuthology.orchestra.run.smithi197.stderr:Sending period to new master zone fdbd535a-3fb6-49cb-8b49-68faf14e40fe 2021-07-26T15:37:17.982 INFO:teuthology.orchestra.run.smithi197.stdout:{"id":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","epoch":2,"predecessor_uuid":"020d7ea2-e91f-4b2e-a208-89d15bc5931e","sync_status":[],"period_map":{"id":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://smithi183.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe","zones":[{"id":"1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d","name":"test-zone2","endpoints":["http://smithi197.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe","name":"test-zone1","endpoints":["http://smithi183.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"d1743e17-c3cb-4823-84fd-b11c05487344","sync_policy":{"groups":[]}}],"short_zone_ids":[{"key":"1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d","val":841289883},{"key":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe","val":2260121961}]},"master_zonegroup":"test-zonegroup","master_zone":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"d1743e17-c3cb-4823-84fd-b11c05487344","realm_name":"test-realm","realm_epoch":2} 2021-07-26T15:37:17.983 DEBUG:tasks.rgw.c2.client.0:waiting for process to exit 2021-07-26T15:37:17.983 INFO:teuthology.orchestra.run:waiting for 300 2021-07-26T15:37:17.985 INFO:tasks.rgw.c2.client.0.smithi197.stdout:2021-07-26T15:37:17.978+0000 7f133d456700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=8000 -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground (PID: 15877) UID: 0 2021-07-26T15:37:17.985 INFO:tasks.rgw.c2.client.0.smithi197.stdout:2021-07-26T15:37:17.978+0000 7f1341830980 -1 shutting down 2021-07-26T15:37:22.972 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~0s 2021-07-26T15:37:24.085 INFO:tasks.rgw.c2.client.0:Stopped 2021-07-26T15:37:24.086 INFO:tasks.rgw.c2.client.0:Restarting daemon 2021-07-26T15:37:24.086 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c2.client.0.stdout 2>&1 2021-07-26T15:37:24.089 INFO:tasks.rgw.c2.client.0:Started 2021-07-26T15:37:24.089 DEBUG:teuthology.orchestra.run.smithi197:> curl http://smithi197.front.sepia.ceph.com:8000 2021-07-26T15:37:24.107 INFO:teuthology.orchestra.run.smithi197.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-07-26T15:37:24.107 INFO:teuthology.orchestra.run.smithi197.stderr: Dload Upload Total Spent Left Speed 2021-07-26T15:37:24.108 INFO:teuthology.orchestra.run.smithi197.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2021-07-26T15:37:24.108 INFO:teuthology.orchestra.run.smithi197.stderr:curl: (7) Failed to connect to smithi197.front.sepia.ceph.com port 8000: Connection refused 2021-07-26T15:37:24.109 DEBUG:teuthology.orchestra.run:got remote process result: 7 2021-07-26T15:37:25.110 DEBUG:teuthology.orchestra.run.smithi197:> curl http://smithi197.front.sepia.ceph.com:8000 2021-07-26T15:37:25.127 INFO:teuthology.orchestra.run.smithi197.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-07-26T15:37:25.128 INFO:teuthology.orchestra.run.smithi197.stderr: Dload Upload Total Spent Left Speed 2021-07-26T15:37:25.129 INFO:teuthology.orchestra.run.smithi197.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 208k 0 --:--:-- --:--:-- --:--:-- 208k 2021-07-26T15:37:25.130 INFO:teuthology.orchestra.run.smithi197.stdout:anonymous 2021-07-26T15:37:25.130 INFO:tasks.rgw_multisite:pulling realm configuration to c2 2021-07-26T15:37:25.131 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['realm', 'pull', '--rgw-realm', 'test-realm', '--url', 'http://smithi183.front.sepia.ceph.com:8000', '--access-key', 'ZVEPLG55FHAYZUFC', '--secret', 'fSeMFeFOakj53SxFrtZZrsnDzPpkESXF', '--url', 'http://smithi183.front.sepia.ceph.com:8000', '--access-key', 'ZVEPLG55FHAYZUFC', '--secret', 'fSeMFeFOakj53SxFrtZZrsnDzPpkESXF', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:37:25.131 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'realm', 'pull', '--rgw-realm', 'test-realm', '--url', 'http://smithi183.front.sepia.ceph.com:8000', '--access-key', 'ZVEPLG55FHAYZUFC', '--secret', 'fSeMFeFOakj53SxFrtZZrsnDzPpkESXF', '--url', 'http://smithi183.front.sepia.ceph.com:8000', '--access-key', 'ZVEPLG55FHAYZUFC', '--secret', 'fSeMFeFOakj53SxFrtZZrsnDzPpkESXF', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:37:25.131 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 realm pull --rgw-realm test-realm --url http://smithi183.front.sepia.ceph.com:8000 --access-key ZVEPLG55FHAYZUFC --secret fSeMFeFOakj53SxFrtZZrsnDzPpkESXF --url http://smithi183.front.sepia.ceph.com:8000 --access-key ZVEPLG55FHAYZUFC --secret fSeMFeFOakj53SxFrtZZrsnDzPpkESXF --cluster c2 --debug-rgw 0 --debug-ms 0 2021-07-26T15:37:25.177 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:37:25.178 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:37:25.218 INFO:tasks.rgw.c2.client.0.smithi197.stdout:2021-07-26T15:37:25.210+0000 7fa69760e700 -1 rgw realm watcher: RGWRealmWatcher::handle_error oid=realms.d1743e17-c3cb-4823-84fd-b11c05487344.control err=-107 2021-07-26T15:37:25.243 INFO:teuthology.orchestra.run.smithi197.stdout:{"id":"d1743e17-c3cb-4823-84fd-b11c05487344","name":"test-realm","current_period":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","epoch":2} 2021-07-26T15:37:25.244 INFO:tasks.rgw_multisite:creating zone.. 2021-07-26T15:37:25.244 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'create', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--access-key', 'ZVEPLG55FHAYZUFC', '--secret', 'fSeMFeFOakj53SxFrtZZrsnDzPpkESXF', '--endpoints', 'http://smithi197.front.sepia.ceph.com:8001', '--tier-type', 'pubsub', '--sync-from-all=0', '--sync-from', 'test-zone1', '--tier-config', 'start_with_full_sync=false,event_retention_days=7', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:37:25.245 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'create', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--access-key', 'ZVEPLG55FHAYZUFC', '--secret', 'fSeMFeFOakj53SxFrtZZrsnDzPpkESXF', '--endpoints', 'http://smithi197.front.sepia.ceph.com:8001', '--tier-type', 'pubsub', '--sync-from-all=0', '--sync-from', 'test-zone1', '--tier-config', 'start_with_full_sync=false,event_retention_days=7', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:37:25.246 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone create --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --access-key ZVEPLG55FHAYZUFC --secret fSeMFeFOakj53SxFrtZZrsnDzPpkESXF --endpoints http://smithi197.front.sepia.ceph.com:8001 --tier-type pubsub --sync-from-all=0 --sync-from test-zone1 --tier-config start_with_full_sync=false,event_retention_days=7 --cluster c2 --debug-rgw 0 --debug-ms 0 2021-07-26T15:37:25.295 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:37:25.295 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:37:25.347 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:37:25.342+0000 7f034ea45980 0 failed reading obj info from .rgw.root:zone_info.fdbd535a-3fb6-49cb-8b49-68faf14e40fe: (2) No such file or directory 2021-07-26T15:37:25.347 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:37:25.342+0000 7f034ea45980 0 WARNING: could not read zone params for zone id=fdbd535a-3fb6-49cb-8b49-68faf14e40fe name=test-zone1 2021-07-26T15:37:25.357 INFO:teuthology.orchestra.run.smithi197.stdout:{"id":"279e5f25-fca9-4d30-8a59-b5dbb281c553","name":"test-zone3","domain_root":"test-zone3.rgw.meta:root","control_pool":"test-zone3.rgw.control","gc_pool":"test-zone3.rgw.log:gc","lc_pool":"test-zone3.rgw.log:lc","log_pool":"test-zone3.rgw.log","intent_log_pool":"test-zone3.rgw.log:intent","usage_log_pool":"test-zone3.rgw.log:usage","roles_pool":"test-zone3.rgw.meta:roles","reshard_pool":"test-zone3.rgw.log:reshard","user_keys_pool":"test-zone3.rgw.meta:users.keys","user_email_pool":"test-zone3.rgw.meta:users.email","user_swift_pool":"test-zone3.rgw.meta:users.swift","user_uid_pool":"test-zone3.rgw.meta:users.uid","otp_pool":"test-zone3.rgw.otp","system_key":{"access_key":"ZVEPLG55FHAYZUFC","secret_key":"fSeMFeFOakj53SxFrtZZrsnDzPpkESXF"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone3.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone3.rgw.buckets.data"}},"data_extra_pool":"test-zone3.rgw.buckets.non-ec","index_type":0}}],"tier_config":{"event_retention_days":7,"start_with_full_sync":false},"realm_id":"d1743e17-c3cb-4823-84fd-b11c05487344"} 2021-07-26T15:37:25.357 DEBUG:teuthology.orchestra.run.smithi197:> sudo ceph osd pool create test-zone3.rgw.buckets.data 64 64 --cluster c2 2021-07-26T15:37:25.751 INFO:teuthology.orchestra.run.smithi197.stderr:pool 'test-zone3.rgw.buckets.data' created 2021-07-26T15:37:25.765 DEBUG:teuthology.orchestra.run.smithi197:> sudo ceph osd pool application enable test-zone3.rgw.buckets.data rgw --cluster c2 2021-07-26T15:37:26.764 INFO:teuthology.orchestra.run.smithi197.stderr:enabled application 'rgw' on pool 'test-zone3.rgw.buckets.data' 2021-07-26T15:37:26.794 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'placement', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:37:26.794 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'placement', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:37:26.795 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone placement --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm modify --placement-id default-placement --compression random --cluster c2 --debug-rgw 0 --debug-ms 0 2021-07-26T15:37:26.827 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:37:26.828 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:37:26.855 INFO:teuthology.orchestra.run.smithi197.stdout:{"id":"279e5f25-fca9-4d30-8a59-b5dbb281c553","name":"test-zone3","domain_root":"test-zone3.rgw.meta:root","control_pool":"test-zone3.rgw.control","gc_pool":"test-zone3.rgw.log:gc","lc_pool":"test-zone3.rgw.log:lc","log_pool":"test-zone3.rgw.log","intent_log_pool":"test-zone3.rgw.log:intent","usage_log_pool":"test-zone3.rgw.log:usage","roles_pool":"test-zone3.rgw.meta:roles","reshard_pool":"test-zone3.rgw.log:reshard","user_keys_pool":"test-zone3.rgw.meta:users.keys","user_email_pool":"test-zone3.rgw.meta:users.email","user_swift_pool":"test-zone3.rgw.meta:users.swift","user_uid_pool":"test-zone3.rgw.meta:users.uid","otp_pool":"test-zone3.rgw.otp","system_key":{"access_key":"ZVEPLG55FHAYZUFC","secret_key":"fSeMFeFOakj53SxFrtZZrsnDzPpkESXF"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone3.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone3.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone3.rgw.buckets.non-ec","index_type":0}}],"tier_config":{"event_retention_days":7,"start_with_full_sync":false},"realm_id":""} 2021-07-26T15:37:26.856 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:37:26.856 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:37:26.856 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2021-07-26T15:37:26.932 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:37:26.932 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:37:28.683 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 has been restored 2021-07-26T15:37:34.920 INFO:teuthology.orchestra.run.smithi197.stderr:Sending period to new master zone fdbd535a-3fb6-49cb-8b49-68faf14e40fe 2021-07-26T15:37:35.004 INFO:teuthology.orchestra.run.smithi197.stdout:{"id":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","epoch":3,"predecessor_uuid":"020d7ea2-e91f-4b2e-a208-89d15bc5931e","sync_status":[],"period_map":{"id":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://smithi183.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe","zones":[{"id":"1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d","name":"test-zone2","endpoints":["http://smithi197.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"279e5f25-fca9-4d30-8a59-b5dbb281c553","name":"test-zone3","endpoints":["http://smithi197.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""},{"id":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe","name":"test-zone1","endpoints":["http://smithi183.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"d1743e17-c3cb-4823-84fd-b11c05487344","sync_policy":{"groups":[]}}],"short_zone_ids":[{"key":"1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d","val":841289883},{"key":"279e5f25-fca9-4d30-8a59-b5dbb281c553","val":1085791465},{"key":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe","val":2260121961}]},"master_zonegroup":"test-zonegroup","master_zone":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"d1743e17-c3cb-4823-84fd-b11c05487344","realm_name":"test-realm","realm_epoch":2} 2021-07-26T15:37:35.004 DEBUG:tasks.rgw.c2.client.1:waiting for process to exit 2021-07-26T15:37:35.005 INFO:teuthology.orchestra.run:waiting for 300 2021-07-26T15:37:35.006 INFO:tasks.rgw.c2.client.1.smithi197.stdout:2021-07-26T15:37:35.002+0000 7f7ce6ffd700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=8001 -n client.1 --cluster c2 -k /etc/ceph/c2.client.1.keyring --log-file /var/log/ceph/rgw.c2.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.1.sock --foreground (PID: 15880) UID: 0 2021-07-26T15:37:35.006 INFO:tasks.rgw.c2.client.1.smithi197.stdout:2021-07-26T15:37:35.002+0000 7f7cef67b980 -1 shutting down 2021-07-26T15:37:35.100 INFO:tasks.rgw.c2.client.1:Stopped 2021-07-26T15:37:35.101 INFO:tasks.rgw.c2.client.1:Restarting daemon 2021-07-26T15:37:35.102 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8001' -n client.1 --cluster c2 -k /etc/ceph/c2.client.1.keyring --log-file /var/log/ceph/rgw.c2.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.1.sock --foreground --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c2.client.1.stdout 2>&1 2021-07-26T15:37:35.147 INFO:tasks.rgw.c2.client.1:Started 2021-07-26T15:37:35.148 DEBUG:teuthology.orchestra.run.smithi197:> curl http://smithi197.front.sepia.ceph.com:8001 2021-07-26T15:37:35.166 INFO:teuthology.orchestra.run.smithi197.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-07-26T15:37:35.173 DEBUG:teuthology.orchestra.run:got remote process result: 7 2021-07-26T15:37:35.174 INFO:teuthology.orchestra.run.smithi197.stderr: Dload Upload Total Spent Left Speed 2021-07-26T15:37:35.174 INFO:teuthology.orchestra.run.smithi197.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2021-07-26T15:37:35.175 INFO:teuthology.orchestra.run.smithi197.stderr:curl: (7) Failed to connect to smithi197.front.sepia.ceph.com port 8001: Connection refused 2021-07-26T15:37:36.178 DEBUG:teuthology.orchestra.run.smithi197:> curl http://smithi197.front.sepia.ceph.com:8001 2021-07-26T15:37:36.193 INFO:teuthology.orchestra.run.smithi197.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-07-26T15:37:36.193 INFO:teuthology.orchestra.run.smithi197.stderr: Dload Upload Total Spent Left Speed 2021-07-26T15:37:36.195 INFO:teuthology.orchestra.run.smithi197.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 134 100 134 0 0 130k 0 --:--:-- --:--:-- --:--:-- 130k 2021-07-26T15:37:36.196 INFO:teuthology.orchestra.run.smithi197.stdout:{"Code":"MethodNotAllowed","RequestId":"tx000000000000000000001-0060fed6c0-10df-test-zone3","HostId":"10df-test-zone3-test-zonegroup"} 2021-07-26T15:37:36.197 INFO:tasks.rgw_multisite:rgw multisite configuration completed 2021-07-26T15:37:36.197 INFO:teuthology.run_tasks:Running task rgw-multisite-tests... 2021-07-26T15:37:36.211 INFO:tasks.rgw_multisite_tests:cloning suite branch octopus from https://github.com/ceph/ceph.git... 2021-07-26T15:37:36.218 DEBUG:teuthology.repo_utils:Setting repo remote to https://github.com/ceph/ceph.git 2021-07-26T15:37:36.243 INFO:teuthology.repo_utils:Fetching octopus from origin 2021-07-26T15:37:37.527 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/github.com_ceph_ceph_octopus to origin/octopus 2021-07-26T15:37:38.285 INFO:tasks.rgw_multisite_tests:importing tests from /home/teuthworker/src/github.com_ceph_ceph_octopus/src/test/rgw/rgw_multi 2021-07-26T15:37:38.308 INFO:tasks.rgw_multisite_tests:creating test user.. 2021-07-26T15:37:38.309 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['user', 'create', '--uid', 'rgw-multisite-test-user', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--display-name', 'Multisite Test User', '--gen-access-key', '--gen-secret', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:37:38.310 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'user', 'create', '--uid', 'rgw-multisite-test-user', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--display-name', 'Multisite Test User', '--gen-access-key', '--gen-secret', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:37:38.310 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 user create --uid rgw-multisite-test-user --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --display-name 'Multisite Test User' --gen-access-key --gen-secret --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:37:38.354 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:37:38.354 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:37:38.516 INFO:teuthology.orchestra.run.smithi183.stdout:{"user_id":"rgw-multisite-test-user","display_name":"Multisite Test User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"rgw-multisite-test-user","access_key":"AIQ0Z7KWGZGBC8MMZGMB","secret_key":"MC2D9YUkiBXs2u5kpBX8g6gmHXvliLL1OXYdDlhA"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2021-07-26T15:37:38.543 INFO:rgw_multi.tests:meta checkpoint 2021-07-26T15:37:38.544 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:37:38.544 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:37:38.545 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:37:38.582 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:37:38.583 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:37:38.739 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=973db1f6-3ec7-4bde-a829-51b8cda6e0ef 2021-07-26T15:37:38.769 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"1_1627313858.513002_27.1","last_update":"2021-07-26T15:37:38.513002Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:37:38.769 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:37:38.769 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:37:38.770 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:37:38.770 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:37:38.813 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:37:38.813 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:37:39.003 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:37:39.004 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627313858.513002_27.1 target= 2021-07-26T15:37:44.005 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:37:44.006 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:37:44.006 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:37:44.049 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:37:44.050 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:37:44.247 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:37:44.248 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627313858.513002_27.1 target= 2021-07-26T15:37:49.250 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:37:49.251 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:37:49.252 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:37:49.291 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:37:49.291 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:37:49.488 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:37:49.488 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627313858.513002_27.1 target= 2021-07-26T15:37:54.489 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:37:54.490 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:37:54.491 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:37:54.530 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:37:54.530 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:37:54.723 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:37:54.724 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627313858.513002_27.1 target= 2021-07-26T15:37:59.725 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:37:59.726 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:37:59.727 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:37:59.768 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:37:59.769 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:37:59.952 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:37:59.953 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627313858.513002_27.1 target= 2021-07-26T15:38:04.954 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:38:04.955 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:38:04.956 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:38:04.995 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:38:04.995 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:38:05.192 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:38:05.193 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627313858.513002_27.1 target= 2021-07-26T15:38:10.195 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:38:10.195 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:38:10.196 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:38:10.236 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:38:10.237 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:38:10.444 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:38:10.445 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627313858.513002_27.1 target= 2021-07-26T15:38:15.446 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:38:15.447 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:38:15.447 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:38:15.487 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:38:15.488 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:38:15.685 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:38:15.686 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627313858.513002_27.1 target= 2021-07-26T15:38:20.687 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:38:20.687 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:38:20.688 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:38:20.727 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:38:20.728 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:38:20.921 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:38:20.922 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627313858.513002_27.1 target= 2021-07-26T15:38:25.923 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:38:25.924 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:38:25.926 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:38:25.965 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:38:25.966 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:38:26.151 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:38:26.152 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627313858.513002_27.1 target= 2021-07-26T15:38:31.153 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:38:31.153 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:38:31.154 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:38:31.196 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:38:31.196 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:38:31.376 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:38:31.377 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627313858.513002_27.1 target= 2021-07-26T15:38:36.378 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:38:36.379 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:38:36.379 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:38:36.421 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:38:36.422 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:38:36.611 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:38:36.612 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627313858.513002_27.1 target= 2021-07-26T15:38:41.612 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:38:41.613 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:38:41.613 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:38:41.654 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:38:41.654 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:38:41.846 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:38:41.847 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627313858.513002_27.1 target= 2021-07-26T15:38:46.849 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:38:46.849 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:38:46.850 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:38:46.892 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:38:46.893 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:38:47.081 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:38:47.081 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627313858.513002_27.1 target= 2021-07-26T15:38:52.083 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:38:52.084 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:38:52.084 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:38:52.125 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:38:52.126 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:38:52.317 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:38:52.319 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627313858.513002_27.1 target= 2021-07-26T15:38:57.321 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:38:57.321 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:38:57.322 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:38:57.363 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:38:57.364 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:38:57.552 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:38:57.553 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627313858.513002_27.1 target= 2021-07-26T15:39:02.553 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:02.554 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:02.555 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:39:02.594 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:39:02.595 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:39:02.784 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:39:02.785 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627313858.513002_27.1 target= 2021-07-26T15:39:07.786 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:07.787 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:07.788 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:39:07.827 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:39:07.827 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:39:08.027 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:39:08.028 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627313858.513002_27.1 target= 2021-07-26T15:39:13.028 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:13.029 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:13.030 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:39:13.075 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:39:13.075 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:39:13.262 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:39:13.263 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627313858.513002_27.1 target= 2021-07-26T15:39:18.264 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:18.264 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:18.265 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:39:18.305 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:39:18.305 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:39:18.488 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:39:18.488 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627313858.513002_27.1 target= 2021-07-26T15:39:23.489 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:23.491 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:23.491 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:39:23.549 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:39:23.550 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:39:23.740 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:39:23.741 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627313858.513002_27.1 target= 2021-07-26T15:39:28.743 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:28.743 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:28.744 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:39:28.788 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:39:28.789 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:39:28.978 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:39:28.979 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627313858.513002_27.1 target= 2021-07-26T15:39:33.980 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:33.981 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:33.982 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:39:34.022 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:39:34.023 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:39:34.223 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:39:34.223 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627313858.513002_27.1 target= 2021-07-26T15:39:39.224 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:39.225 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:39.225 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:39:39.265 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:39:39.266 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:39:39.453 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:39:39.454 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:39:39.454 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:39:39.455 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:39.455 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:39.456 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:39:39.495 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:39:39.496 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:39:39.697 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:39:39.697 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:39:39.698 INFO:rgw_multi.tests:meta checkpoint 2021-07-26T15:39:39.698 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:39.699 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:39.699 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:39:39.739 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:39:39.739 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:39:39.919 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=973db1f6-3ec7-4bde-a829-51b8cda6e0ef 2021-07-26T15:39:39.950 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"1_1627313858.513002_27.1","last_update":"2021-07-26T15:37:38.513002Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:39:39.950 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:39:39.950 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:39.951 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:39.951 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:39:39.992 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:39:39.992 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:39:40.181 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:39:40.182 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:39:40.182 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:39:40.183 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:40.183 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:40.184 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:39:40.222 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:39:40.223 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:39:40.420 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:39:40.421 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:39:40.421 INFO:tasks.rgw_multisite_tests:running rgw multisite tests on '/home/teuthworker/src/github.com_ceph_ceph_octopus/src/test/rgw/rgw_multi' with args=['tests.py', 'tests_ps.py'] 2021-07-26T15:39:40.489 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=mnwbfc-1 2021-07-26T15:39:44.504 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=mnwbfc-2 2021-07-26T15:39:47.715 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:47.716 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:47.716 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:39:47.756 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:39:47.757 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:39:47.919 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=973db1f6-3ec7-4bde-a829-51b8cda6e0ef 2021-07-26T15:39:47.950 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"1_1627313858.513002_27.1","last_update":"2021-07-26T15:37:38.513002Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627313984.541852_46.1","last_update":"2021-07-26T15:39:44.541852Z"}] 2021-07-26T15:39:47.951 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:39:47.952 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:47.952 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:47.953 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:39:47.993 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:39:47.993 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:39:48.186 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1627313984.541852_46.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:39:44.541852Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:39:48.188 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:39:48.189 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:39:48.189 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:48.190 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:48.190 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:39:48.266 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:39:48.266 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:39:48.461 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1627313984.492727_38.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:39:44.492727Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:39:48.462 WARNING:rgw_multi.tests:zone test-zone3 behind master: shard=3 master=1_1627313984.541852_46.1 target=1_1627313984.492727_38.1 2021-07-26T15:39:53.463 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:53.464 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:53.465 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:39:53.506 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:39:53.507 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:39:53.697 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1627313984.541852_46.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:39:44.541852Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:39:53.697 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:39:53.716 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_create ... ok 2021-07-26T15:39:53.718 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=mnwbfc-3 2021-07-26T15:39:53.744 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=mnwbfc-4 2021-07-26T15:39:53.792 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:53.793 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:53.794 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:39:53.833 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:39:53.833 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:39:54.009 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=973db1f6-3ec7-4bde-a829-51b8cda6e0ef 2021-07-26T15:39:54.039 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"1_1627313858.513002_27.1","last_update":"2021-07-26T15:37:38.513002Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627313993.780278_55.1","last_update":"2021-07-26T15:39:53.780278Z"}] 2021-07-26T15:39:54.040 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:39:54.040 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:54.041 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:54.041 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:39:54.081 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:39:54.082 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:39:54.280 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1627313993.780278_55.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:39:53.780278Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:39:54.287 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:39:54.287 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:39:54.288 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:54.288 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:54.289 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:39:54.348 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:39:54.348 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:39:54.535 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1627313993.780278_55.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:39:53.780278Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:39:54.536 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:39:54.795 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:54.796 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:54.799 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:39:54.848 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:39:54.849 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:39:55.012 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=973db1f6-3ec7-4bde-a829-51b8cda6e0ef 2021-07-26T15:39:55.041 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"1_1627313858.513002_27.1","last_update":"2021-07-26T15:37:38.513002Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627313994.742358_71.1","last_update":"2021-07-26T15:39:54.742358Z"}] 2021-07-26T15:39:55.042 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:39:55.042 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:55.043 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:55.044 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:39:55.084 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:39:55.085 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:39:55.274 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1627313994.742358_71.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:39:54.742358Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:39:55.274 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:39:55.275 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:39:55.275 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:55.276 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:55.276 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:39:55.314 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:39:55.314 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:39:55.515 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1627313994.742358_71.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:39:54.742358Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:39:55.516 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:39:55.532 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_recreate ... ok 2021-07-26T15:39:55.533 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=mnwbfc-5 2021-07-26T15:39:55.562 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=mnwbfc-6 2021-07-26T15:39:55.611 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:55.612 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:55.613 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:39:55.653 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:39:55.654 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:39:55.803 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=973db1f6-3ec7-4bde-a829-51b8cda6e0ef 2021-07-26T15:39:55.833 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"1_1627313858.513002_27.1","last_update":"2021-07-26T15:37:38.513002Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627313995.595921_79.1","last_update":"2021-07-26T15:39:55.595921Z"}] 2021-07-26T15:39:55.833 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:39:55.834 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:55.834 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:55.835 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:39:55.873 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:39:55.874 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:39:56.056 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1627313995.595921_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:39:55.595921Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:39:56.057 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:39:56.057 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:39:56.058 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:56.058 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:56.059 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:39:56.139 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:39:56.139 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:39:56.331 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1627313995.595921_79.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:39:55.595921Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:39:56.331 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:39:56.448 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:56.449 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:56.449 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:39:56.483 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:39:56.483 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:39:56.645 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=973db1f6-3ec7-4bde-a829-51b8cda6e0ef 2021-07-26T15:39:56.674 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"1_1627313858.513002_27.1","last_update":"2021-07-26T15:37:38.513002Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627313996.427744_83.1","last_update":"2021-07-26T15:39:56.427744Z"}] 2021-07-26T15:39:56.675 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:39:56.675 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:56.676 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:56.676 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:39:56.718 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:39:56.718 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:39:56.912 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1627313996.427744_83.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:39:56.427744Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:39:56.912 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:39:56.913 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:39:56.913 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:56.914 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:56.914 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:39:56.952 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:39:56.952 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:39:57.145 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1627313996.427744_83.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:39:56.427744Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:39:57.146 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:39:57.153 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_remove ... ok 2021-07-26T15:39:57.153 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=mnwbfc-7 2021-07-26T15:39:57.179 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=mnwbfc-8 2021-07-26T15:39:57.287 INFO:tasks.rgw.c2.client.0.smithi197.stdout:2021-07-26T15:39:57.286+0000 7fa8b17fa700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:39:57.288 INFO:tasks.rgw.c2.client.1.smithi197.stdout:2021-07-26T15:39:57.286+0000 7f76aeffd700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:39:57.289 INFO:tasks.rgw.c2.client.1.smithi197.stdout:2021-07-26T15:39:57.286+0000 7f76a67ec700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:39:57.289 INFO:tasks.rgw.c2.client.0.smithi197.stdout:2021-07-26T15:39:57.290+0000 7fa89a7f4700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:39:57.612 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:57.613 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:57.613 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:39:57.653 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:39:57.654 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:39:57.809 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=973db1f6-3ec7-4bde-a829-51b8cda6e0ef 2021-07-26T15:39:57.839 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"1_1627313858.513002_27.1","last_update":"2021-07-26T15:37:38.513002Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627313997.211404_91.1","last_update":"2021-07-26T15:39:57.211404Z"}] 2021-07-26T15:39:57.840 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:39:57.840 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:57.841 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:57.842 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:39:57.881 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:39:57.881 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:39:58.065 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1627313997.211404_91.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:39:57.211404Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:39:58.065 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:39:58.066 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:39:58.067 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:58.067 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:58.068 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:39:58.105 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:39:58.106 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:39:58.285 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1627313997.211404_91.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:39:57.211404Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:39:58.286 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:39:58.287 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-7', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:58.287 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-7', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:58.288 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-7 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:39:58.333 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:39:58.333 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:39:58.514 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000001.3.5"},{"key":2,"val":""},{"key":3,"val":"00000000001.3.5"},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000001.10.5"},{"key":8,"val":"00000000001.7.5"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:39:58.514 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=mnwbfc-7 2021-07-26T15:39:58.515 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-7', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:58.516 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-7', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:39:58.516 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-7 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:39:58.559 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:39:58.559 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:39:58.789 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"myobj","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.3.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"_myobj","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.3.5"}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"&","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.10.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":":","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.7.5"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:39:58.789 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=mnwbfc-7 2021-07-26T15:39:58.790 INFO:tasks.rgw_multi.zone_rados:comparing bucket=mnwbfc-7 zones={test-zone2, test-zone1} 2021-07-26T15:39:58.797 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:39:58.808 DEBUG:tasks.rgw_multi.zone_rados:o=& 2021-07-26T15:39:58.809 DEBUG:tasks.rgw_multi.zone_rados:o=: 2021-07-26T15:39:58.809 DEBUG:tasks.rgw_multi.zone_rados:o=_myobj 2021-07-26T15:39:58.810 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-07-26T15:39:58.810 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:39:58.859 DEBUG:tasks.rgw_multi.zone_rados:o=& 2021-07-26T15:39:58.860 DEBUG:tasks.rgw_multi.zone_rados:o=: 2021-07-26T15:39:58.860 DEBUG:tasks.rgw_multi.zone_rados:o=_myobj 2021-07-26T15:39:58.861 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-07-26T15:39:58.915 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2021-07-26T15:39:58.969 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2021-07-26T15:39:59.082 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2021-07-26T15:39:59.185 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2021-07-26T15:39:59.239 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2021-07-26T15:39:59.347 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2021-07-26T15:39:59.455 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2021-07-26T15:39:59.507 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2021-07-26T15:39:59.628 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2021-07-26T15:39:59.732 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-07-26T15:39:59.793 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-07-26T15:39:59.906 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-07-26T15:40:00.005 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=mnwbfc-7 zones={test-zone2, test-zone1} 2021-07-26T15:40:00.005 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-7', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:00.006 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-7', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:00.007 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-7 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:00.045 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:00.045 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:00.223 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000001.3.5"},{"key":2,"val":""},{"key":3,"val":"00000000001.3.5"},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000001.10.5"},{"key":8,"val":"00000000001.7.5"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:40:00.225 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-7 2021-07-26T15:40:00.225 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-7', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:00.226 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-7', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:00.227 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-7 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:00.269 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:00.270 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:00.488 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.3.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.3.5"}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.10.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.7.5"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:40:00.489 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-7 2021-07-26T15:40:00.489 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-8', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:00.490 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-8', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:00.490 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-8 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:00.530 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:00.531 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:00.725 INFO:teuthology.orchestra.run.smithi197.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000001.11.5"},{"key":2,"val":""},{"key":3,"val":"00000000001.11.5"},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000001.7.5"},{"key":8,"val":"00000000001.10.5"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:40:00.726 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=mnwbfc-8 2021-07-26T15:40:00.727 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'mnwbfc-8', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:00.727 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'mnwbfc-8', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:00.728 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket mnwbfc-8 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:00.771 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:00.771 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:00.982 INFO:teuthology.orchestra.run.smithi183.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"myobj","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.11.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"_myobj","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.11.5"}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"&","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.7.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":":","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.10.5"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:40:00.983 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=mnwbfc-8 2021-07-26T15:40:00.983 INFO:tasks.rgw_multi.zone_rados:comparing bucket=mnwbfc-8 zones={test-zone1, test-zone2} 2021-07-26T15:40:00.992 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:40:00.999 DEBUG:tasks.rgw_multi.zone_rados:o=& 2021-07-26T15:40:00.999 DEBUG:tasks.rgw_multi.zone_rados:o=: 2021-07-26T15:40:01.000 DEBUG:tasks.rgw_multi.zone_rados:o=_myobj 2021-07-26T15:40:01.000 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-07-26T15:40:01.001 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:40:01.006 DEBUG:tasks.rgw_multi.zone_rados:o=& 2021-07-26T15:40:01.007 DEBUG:tasks.rgw_multi.zone_rados:o=: 2021-07-26T15:40:01.007 DEBUG:tasks.rgw_multi.zone_rados:o=_myobj 2021-07-26T15:40:01.008 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-07-26T15:40:01.064 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2021-07-26T15:40:01.120 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2021-07-26T15:40:01.233 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2021-07-26T15:40:01.336 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2021-07-26T15:40:01.391 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2021-07-26T15:40:01.505 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2021-07-26T15:40:01.616 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2021-07-26T15:40:01.674 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2021-07-26T15:40:01.785 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2021-07-26T15:40:01.888 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-07-26T15:40:01.943 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-07-26T15:40:02.047 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-07-26T15:40:02.152 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=mnwbfc-8 zones={test-zone1, test-zone2} 2021-07-26T15:40:02.153 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_object_sync ... ok 2021-07-26T15:40:02.154 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=mnwbfc-9 2021-07-26T15:40:02.181 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=mnwbfc-10 2021-07-26T15:40:02.288 INFO:tasks.rgw.c2.client.1.smithi197.stdout:2021-07-26T15:40:02.286+0000 7f76a47e8700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:40:02.288 INFO:tasks.rgw.c2.client.0.smithi197.stdout:2021-07-26T15:40:02.286+0000 7fa8967ec700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:40:02.289 INFO:tasks.rgw.c2.client.1.smithi197.stdout:2021-07-26T15:40:02.290+0000 7f76adffb700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:40:02.290 INFO:tasks.rgw.c2.client.0.smithi197.stdout:2021-07-26T15:40:02.290+0000 7fa897fef700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:40:02.327 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:02.328 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:02.328 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:02.369 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:02.369 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:02.542 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=973db1f6-3ec7-4bde-a829-51b8cda6e0ef 2021-07-26T15:40:02.568 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"1_1627313858.513002_27.1","last_update":"2021-07-26T15:37:38.513002Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314002.214845_80.1","last_update":"2021-07-26T15:40:02.214845Z"},{"marker":"1_1627314002.183348_103.1","last_update":"2021-07-26T15:40:02.183348Z"}] 2021-07-26T15:40:02.568 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:40:02.569 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:02.569 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:02.570 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:02.609 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:02.609 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:02.800 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314002.214845_80.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.214845Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:40:02.800 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:40:02.801 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:40:02.801 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:02.802 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:02.802 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:02.840 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:02.840 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:03.037 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314002.214845_80.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.214845Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:40:03.038 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:40:03.040 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-9', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:03.041 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-9', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:03.042 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-9 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:03.084 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:03.085 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:03.300 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000001.13.5"},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:40:03.300 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=mnwbfc-9 2021-07-26T15:40:03.301 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-9', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:03.301 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-9', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:03.302 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-9 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:03.345 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:03.345 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:03.555 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"myobj","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.13.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:40:03.555 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=mnwbfc-9 2021-07-26T15:40:03.556 INFO:tasks.rgw_multi.zone_rados:comparing bucket=mnwbfc-9 zones={test-zone2, test-zone1} 2021-07-26T15:40:03.566 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:40:03.615 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-07-26T15:40:03.616 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:40:03.621 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-07-26T15:40:03.672 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-07-26T15:40:03.727 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-07-26T15:40:03.843 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-07-26T15:40:03.945 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=mnwbfc-9 zones={test-zone2, test-zone1} 2021-07-26T15:40:03.947 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-9', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:03.948 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-9', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:03.949 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-9 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:03.992 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:03.992 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:04.182 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000001.13.5"},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:40:04.183 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-9 2021-07-26T15:40:04.183 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-9', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:04.184 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-9', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:04.185 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-9 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:04.235 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:04.236 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:04.417 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.13.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:40:04.418 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-9 2021-07-26T15:40:04.419 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-10', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:04.420 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-10', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:04.421 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-10 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:04.467 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:04.467 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:04.674 INFO:teuthology.orchestra.run.smithi197.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000001.9.5"},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:40:04.675 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=mnwbfc-10 2021-07-26T15:40:04.675 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'mnwbfc-10', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:04.676 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'mnwbfc-10', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:04.676 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket mnwbfc-10 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:04.725 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:04.726 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:04.939 INFO:teuthology.orchestra.run.smithi183.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"myobj","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.9.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:40:04.940 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=mnwbfc-10 2021-07-26T15:40:04.941 INFO:tasks.rgw_multi.zone_rados:comparing bucket=mnwbfc-10 zones={test-zone1, test-zone2} 2021-07-26T15:40:04.951 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:40:04.999 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-07-26T15:40:05.000 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:40:05.006 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-07-26T15:40:05.060 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-07-26T15:40:05.115 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-07-26T15:40:05.221 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-07-26T15:40:05.321 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=mnwbfc-10 zones={test-zone1, test-zone2} 2021-07-26T15:40:05.337 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-9', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:05.338 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-9', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:05.339 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-9 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:05.375 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:05.376 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:05.573 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000002.15.5"},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:40:05.573 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=mnwbfc-9 2021-07-26T15:40:05.574 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-9', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:05.574 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-9', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:05.575 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-9 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:05.622 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:05.622 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:05.822 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"myobj","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000002.15.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:40:05.823 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=mnwbfc-9 2021-07-26T15:40:05.823 INFO:tasks.rgw_multi.zone_rados:comparing bucket=mnwbfc-9 zones={test-zone2, test-zone1} 2021-07-26T15:40:05.832 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:40:05.884 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:40:05.940 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=mnwbfc-9 zones={test-zone2, test-zone1} 2021-07-26T15:40:05.941 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-9', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:05.942 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-9', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:05.942 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-9 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:05.983 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:05.983 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:06.170 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000002.15.5"},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:40:06.171 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-9 2021-07-26T15:40:06.173 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-9', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:06.174 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-9', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:06.174 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-9 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:06.217 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:06.218 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:06.414 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.15.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:40:06.415 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-9 2021-07-26T15:40:06.435 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-10', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:06.435 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-10', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:06.436 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-10 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:06.500 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:06.501 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:06.686 INFO:teuthology.orchestra.run.smithi197.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000002.12.5"},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:40:06.686 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=mnwbfc-10 2021-07-26T15:40:06.687 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'mnwbfc-10', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:06.689 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'mnwbfc-10', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:06.689 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket mnwbfc-10 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:06.733 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:06.733 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:06.959 INFO:teuthology.orchestra.run.smithi183.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"myobj","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000002.12.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:40:06.960 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=mnwbfc-10 2021-07-26T15:40:06.961 INFO:tasks.rgw_multi.zone_rados:comparing bucket=mnwbfc-10 zones={test-zone1, test-zone2} 2021-07-26T15:40:06.970 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:40:07.019 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:40:07.081 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=mnwbfc-10 zones={test-zone1, test-zone2} 2021-07-26T15:40:07.081 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_object_delete ... ok 2021-07-26T15:40:07.082 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=mnwbfc-11 2021-07-26T15:40:07.108 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=mnwbfc-12 2021-07-26T15:40:07.184 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:07.184 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:07.185 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:07.224 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:07.225 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:07.405 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=973db1f6-3ec7-4bde-a829-51b8cda6e0ef 2021-07-26T15:40:07.433 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"1_1627313858.513002_27.1","last_update":"2021-07-26T15:37:38.513002Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314007.183769_113.1","last_update":"2021-07-26T15:40:07.183769Z"},{"marker":"1_1627314002.183348_103.1","last_update":"2021-07-26T15:40:02.183348Z"}] 2021-07-26T15:40:07.434 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:40:07.435 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:07.435 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:07.436 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:07.475 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:07.475 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:07.672 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314007.183769_113.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:07.183769Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:40:07.673 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:40:07.674 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:40:07.674 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:07.675 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:07.675 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:07.713 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:07.714 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:07.887 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314007.183769_113.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:07.183769Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:40:07.888 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:40:07.943 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:07.944 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:07.944 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-11 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:07.984 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:07.984 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:08.177 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000002.11.10"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:40:08.178 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=mnwbfc-11 2021-07-26T15:40:08.179 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:08.179 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:08.180 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:08.224 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:08.224 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:08.440 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"AmWsZDZMpPQRMcgCKlS-a.wiAaU1R3W","ns":""},"count":1},"inc_marker":{"position":"00000000002.11.10"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:40:08.440 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=mnwbfc-11 2021-07-26T15:40:08.441 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:08.441 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:08.443 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-11 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:08.485 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:08.486 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:08.667 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000003.13.9"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:40:08.668 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-11 2021-07-26T15:40:08.668 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:08.669 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:08.669 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:08.715 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:08.715 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:08.898 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000003.13.9"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:40:08.898 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-11 2021-07-26T15:40:08.947 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-12', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:08.948 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-12', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:08.949 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-12 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:08.988 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:08.989 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:09.181 INFO:teuthology.orchestra.run.smithi197.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000002.16.10"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:40:09.182 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=mnwbfc-12 2021-07-26T15:40:09.183 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'mnwbfc-12', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:09.183 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'mnwbfc-12', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:09.184 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket mnwbfc-12 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:09.228 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:09.228 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:09.448 INFO:teuthology.orchestra.run.smithi183.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"7hNA.-KHxc3Z2BgkhDYQxm3j-rxbbZ8","ns":""},"count":1},"inc_marker":{"position":"00000000002.16.10"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:40:09.449 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=mnwbfc-12 2021-07-26T15:40:10.206 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:10.207 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:10.208 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-11 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:10.253 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:10.254 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:10.434 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000010.23.5"},{"key":2,"val":""},{"key":3,"val":"00000000002.12.10"},{"key":4,"val":""},{"key":5,"val":"00000000003.13.9"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:40:10.434 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=mnwbfc-11 2021-07-26T15:40:10.435 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:10.435 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:10.436 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:10.481 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:10.481 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:10.683 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone1","instance":"hqRp2Qq4xYApqCdfDVdKvJfYMEsd.ry","ns":""},"count":1},"inc_marker":{"position":"00000000010.23.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone2","instance":"B4d0wASUv3Gsg8Rtbk.GnTOHY7U.h5t","ns":""},"count":1},"inc_marker":{"position":"00000000002.12.10"}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"AmWsZDZMpPQRMcgCKlS-a.wiAaU1R3W","ns":""},"count":1},"inc_marker":{"position":"00000000003.13.9"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:40:10.683 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=mnwbfc-11 2021-07-26T15:40:10.684 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:10.684 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:10.685 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-11 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:10.725 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:10.726 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:10.931 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000010.23.5"},{"key":2,"val":""},{"key":3,"val":"00000000002.12.10"},{"key":4,"val":""},{"key":5,"val":"00000000003.13.9"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:40:10.931 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-11 2021-07-26T15:40:10.932 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:10.933 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:10.934 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:10.977 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:10.977 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:11.193 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000010.23.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.12.10"}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000003.13.9"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:40:11.194 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-11 2021-07-26T15:40:11.195 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:11.195 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:11.196 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:11.236 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:11.237 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:11.438 INFO:teuthology.orchestra.run.smithi197.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000006.19.5"},{"key":2,"val":""},{"key":3,"val":"00000000010.38.5"},{"key":4,"val":""},{"key":5,"val":"00000000002.14.10"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:40:11.439 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=mnwbfc-11 2021-07-26T15:40:11.439 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'mnwbfc-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:11.440 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'mnwbfc-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:11.440 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket mnwbfc-11 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:11.482 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:11.483 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:11.687 INFO:teuthology.orchestra.run.smithi183.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone1","instance":"hqRp2Qq4xYApqCdfDVdKvJfYMEsd.ry","ns":""},"count":2},"inc_marker":{"position":"00000000006.19.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone2","instance":"B4d0wASUv3Gsg8Rtbk.GnTOHY7U.h5t","ns":""},"count":1},"inc_marker":{"position":"00000000010.38.5"}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"AmWsZDZMpPQRMcgCKlS-a.wiAaU1R3W","ns":""},"count":1},"inc_marker":{"position":"00000000002.14.10"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:40:11.688 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=mnwbfc-11 2021-07-26T15:40:11.688 INFO:tasks.rgw_multi.zone_rados:comparing bucket=mnwbfc-11 zones={test-zone2, test-zone1} 2021-07-26T15:40:11.697 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:40:11.702 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2021-07-26T15:40:11.702 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2021-07-26T15:40:11.703 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2021-07-26T15:40:11.703 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:40:11.709 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2021-07-26T15:40:11.710 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2021-07-26T15:40:11.711 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2021-07-26T15:40:11.726 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-07-26T15:40:11.738 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-07-26T15:40:11.803 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-07-26T15:40:11.861 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2021-07-26T15:40:11.918 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2021-07-26T15:40:12.032 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2021-07-26T15:40:12.144 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2021-07-26T15:40:12.201 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2021-07-26T15:40:12.330 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2021-07-26T15:40:12.428 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=mnwbfc-11 zones={test-zone2, test-zone1} 2021-07-26T15:40:12.428 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-12', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:12.429 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-12', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:12.429 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-12 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:12.469 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:12.470 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:12.663 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000010.25.5"},{"key":2,"val":""},{"key":3,"val":"00000000006.21.5"},{"key":4,"val":""},{"key":5,"val":"00000000002.9.10"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:40:12.664 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=mnwbfc-12 2021-07-26T15:40:12.664 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-12', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:12.665 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-12', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:12.666 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-12 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:12.710 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:12.710 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:12.915 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone1","instance":"mcmn8mH2XhZV2GdIDXj0QMNCBOzWaYf","ns":""},"count":2},"inc_marker":{"position":"00000000010.25.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone2","instance":"X7a89w1YJpcEKp4q8WcGzoSYbQAzBDQ","ns":""},"count":1},"inc_marker":{"position":"00000000006.21.5"}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"7hNA.-KHxc3Z2BgkhDYQxm3j-rxbbZ8","ns":""},"count":1},"inc_marker":{"position":"00000000002.9.10"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:40:12.916 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=mnwbfc-12 2021-07-26T15:40:12.916 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-12', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:12.917 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-12', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:12.918 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-12 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:12.961 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:12.961 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:13.153 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000010.25.5"},{"key":2,"val":""},{"key":3,"val":"00000000006.21.5"},{"key":4,"val":""},{"key":5,"val":"00000000002.9.10"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:40:13.153 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-12 2021-07-26T15:40:13.154 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-12', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:13.155 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-12', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:13.155 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-12 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:13.199 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:13.200 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:13.412 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000010.25.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.21.5"}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.9.10"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:40:13.413 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-12 2021-07-26T15:40:13.413 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-12', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:13.414 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-12', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:13.415 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-12 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:13.499 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:13.500 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:13.689 INFO:teuthology.orchestra.run.smithi197.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000006.24.5"},{"key":2,"val":""},{"key":3,"val":"00000000010.38.5"},{"key":4,"val":""},{"key":5,"val":"00000000003.18.9"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:40:13.690 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=mnwbfc-12 2021-07-26T15:40:13.690 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'mnwbfc-12', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:13.691 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'mnwbfc-12', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:13.691 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket mnwbfc-12 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:13.737 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:13.738 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:13.956 INFO:teuthology.orchestra.run.smithi183.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone1","instance":"mcmn8mH2XhZV2GdIDXj0QMNCBOzWaYf","ns":""},"count":2},"inc_marker":{"position":"00000000006.24.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone2","instance":"sf1rn5BUGOTFggdkQcWTPpQuJ4q-Xyx","ns":""},"count":1},"inc_marker":{"position":"00000000010.38.5"}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"7hNA.-KHxc3Z2BgkhDYQxm3j-rxbbZ8","ns":""},"count":1},"inc_marker":{"position":"00000000003.18.9"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:40:13.961 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=mnwbfc-12 2021-07-26T15:40:13.962 INFO:tasks.rgw_multi.zone_rados:comparing bucket=mnwbfc-12 zones={test-zone2, test-zone1} 2021-07-26T15:40:13.973 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:40:13.981 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2021-07-26T15:40:13.982 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2021-07-26T15:40:13.982 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2021-07-26T15:40:13.983 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:40:13.991 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2021-07-26T15:40:13.995 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2021-07-26T15:40:13.996 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2021-07-26T15:40:14.020 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-07-26T15:40:14.038 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-07-26T15:40:14.103 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-07-26T15:40:14.161 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2021-07-26T15:40:14.217 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2021-07-26T15:40:14.329 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2021-07-26T15:40:14.437 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2021-07-26T15:40:14.492 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2021-07-26T15:40:14.607 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2021-07-26T15:40:14.710 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=mnwbfc-12 zones={test-zone2, test-zone1} 2021-07-26T15:40:14.988 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:14.989 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:14.989 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-11 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:15.033 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:15.034 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:15.222 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000011.27.5"},{"key":2,"val":""},{"key":3,"val":"00000000003.15.5"},{"key":4,"val":""},{"key":5,"val":"00000000003.13.9"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:40:15.222 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=mnwbfc-11 2021-07-26T15:40:15.223 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:15.223 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:15.224 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:15.268 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:15.268 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:15.467 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone1","instance":"hqRp2Qq4xYApqCdfDVdKvJfYMEsd.ry","ns":""},"count":1},"inc_marker":{"position":"00000000011.27.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone2","instance":"B4d0wASUv3Gsg8Rtbk.GnTOHY7U.h5t","ns":""},"count":1},"inc_marker":{"position":"00000000003.15.5"}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"AmWsZDZMpPQRMcgCKlS-a.wiAaU1R3W","ns":""},"count":1},"inc_marker":{"position":"00000000003.13.9"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:40:15.468 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=mnwbfc-11 2021-07-26T15:40:15.468 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:15.469 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:15.469 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-11 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:15.512 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:15.513 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:15.716 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000011.27.5"},{"key":2,"val":""},{"key":3,"val":"00000000003.15.5"},{"key":4,"val":""},{"key":5,"val":"00000000003.13.9"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:40:15.717 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-11 2021-07-26T15:40:15.719 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:15.720 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:15.720 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:15.765 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:15.765 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:15.963 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000011.27.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000003.15.5"}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000003.13.9"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:40:15.964 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-11 2021-07-26T15:40:15.965 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:15.965 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:15.966 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:16.042 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:16.043 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:16.228 INFO:teuthology.orchestra.run.smithi197.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000007.22.5"},{"key":2,"val":""},{"key":3,"val":"00000000011.42.5"},{"key":4,"val":""},{"key":5,"val":"00000000002.14.10"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:40:16.229 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=mnwbfc-11 2021-07-26T15:40:16.230 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'mnwbfc-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:16.231 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'mnwbfc-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:16.232 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket mnwbfc-11 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:16.277 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:16.277 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:16.470 INFO:teuthology.orchestra.run.smithi183.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone1","instance":"hqRp2Qq4xYApqCdfDVdKvJfYMEsd.ry","ns":""},"count":2},"inc_marker":{"position":"00000000007.22.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone2","instance":"B4d0wASUv3Gsg8Rtbk.GnTOHY7U.h5t","ns":""},"count":1},"inc_marker":{"position":"00000000011.42.5"}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"AmWsZDZMpPQRMcgCKlS-a.wiAaU1R3W","ns":""},"count":1},"inc_marker":{"position":"00000000002.14.10"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:40:16.471 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=mnwbfc-11 2021-07-26T15:40:16.471 INFO:tasks.rgw_multi.zone_rados:comparing bucket=mnwbfc-11 zones={test-zone2, test-zone1} 2021-07-26T15:40:16.481 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:40:16.486 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2021-07-26T15:40:16.486 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2021-07-26T15:40:16.487 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2021-07-26T15:40:16.487 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:40:16.494 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2021-07-26T15:40:16.495 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2021-07-26T15:40:16.495 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2021-07-26T15:40:16.505 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-07-26T15:40:16.521 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-07-26T15:40:16.587 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-07-26T15:40:16.649 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2021-07-26T15:40:16.707 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2021-07-26T15:40:16.813 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2021-07-26T15:40:16.915 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2021-07-26T15:40:16.977 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2021-07-26T15:40:17.098 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2021-07-26T15:40:17.205 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=mnwbfc-11 zones={test-zone2, test-zone1} 2021-07-26T15:40:17.206 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-12', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:17.206 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-12', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:17.207 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-12 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:17.247 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:17.247 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:17.438 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000011.30.5"},{"key":2,"val":""},{"key":3,"val":"00000000007.24.5"},{"key":4,"val":""},{"key":5,"val":"00000000002.9.10"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:40:17.439 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=mnwbfc-12 2021-07-26T15:40:17.440 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-12', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:17.440 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-12', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:17.441 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-12 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:17.484 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:17.485 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:17.684 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone1","instance":"mcmn8mH2XhZV2GdIDXj0QMNCBOzWaYf","ns":""},"count":2},"inc_marker":{"position":"00000000011.30.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone2","instance":"X7a89w1YJpcEKp4q8WcGzoSYbQAzBDQ","ns":""},"count":1},"inc_marker":{"position":"00000000007.24.5"}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"7hNA.-KHxc3Z2BgkhDYQxm3j-rxbbZ8","ns":""},"count":1},"inc_marker":{"position":"00000000002.9.10"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:40:17.684 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=mnwbfc-12 2021-07-26T15:40:17.685 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-12', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:17.685 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-12', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:17.686 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-12 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:17.730 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:17.731 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:17.929 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000011.30.5"},{"key":2,"val":""},{"key":3,"val":"00000000007.24.5"},{"key":4,"val":""},{"key":5,"val":"00000000002.9.10"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:40:17.929 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-12 2021-07-26T15:40:17.930 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-12', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:17.930 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-12', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:17.931 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-12 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:17.975 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:17.976 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:18.169 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000011.30.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000007.24.5"}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.9.10"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:40:18.170 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-12 2021-07-26T15:40:18.174 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-12', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:18.174 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-12', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:18.175 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-12 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:18.258 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:18.258 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:18.442 INFO:teuthology.orchestra.run.smithi197.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000007.27.5"},{"key":2,"val":""},{"key":3,"val":"00000000011.42.5"},{"key":4,"val":""},{"key":5,"val":"00000000003.18.9"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:40:18.447 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=mnwbfc-12 2021-07-26T15:40:18.448 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'mnwbfc-12', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:18.449 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'mnwbfc-12', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:18.466 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket mnwbfc-12 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:18.513 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:18.514 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:18.712 INFO:teuthology.orchestra.run.smithi183.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone1","instance":"mcmn8mH2XhZV2GdIDXj0QMNCBOzWaYf","ns":""},"count":2},"inc_marker":{"position":"00000000007.27.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone2","instance":"sf1rn5BUGOTFggdkQcWTPpQuJ4q-Xyx","ns":""},"count":1},"inc_marker":{"position":"00000000011.42.5"}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"7hNA.-KHxc3Z2BgkhDYQxm3j-rxbbZ8","ns":""},"count":1},"inc_marker":{"position":"00000000003.18.9"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:40:18.713 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=mnwbfc-12 2021-07-26T15:40:18.714 INFO:tasks.rgw_multi.zone_rados:comparing bucket=mnwbfc-12 zones={test-zone2, test-zone1} 2021-07-26T15:40:18.725 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:40:18.733 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2021-07-26T15:40:18.734 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2021-07-26T15:40:18.734 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2021-07-26T15:40:18.735 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:40:18.741 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2021-07-26T15:40:18.741 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2021-07-26T15:40:18.741 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2021-07-26T15:40:18.751 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-07-26T15:40:18.760 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-07-26T15:40:18.827 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-07-26T15:40:18.889 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2021-07-26T15:40:18.947 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2021-07-26T15:40:19.063 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2021-07-26T15:40:19.168 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2021-07-26T15:40:19.227 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2021-07-26T15:40:19.385 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2021-07-26T15:40:19.492 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=mnwbfc-12 zones={test-zone2, test-zone1} 2021-07-26T15:40:19.493 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_versioned_object_incremental_sync ... ok 2021-07-26T15:40:19.535 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:19.536 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:19.539 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:19.577 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:19.578 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:19.748 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=973db1f6-3ec7-4bde-a829-51b8cda6e0ef 2021-07-26T15:40:19.779 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"1_1627313858.513002_27.1","last_update":"2021-07-26T15:37:38.513002Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314019.539764_167.1","last_update":"2021-07-26T15:40:19.539764Z"},{"marker":"1_1627314002.183348_103.1","last_update":"2021-07-26T15:40:02.183348Z"}] 2021-07-26T15:40:19.779 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:40:19.780 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:19.780 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:19.781 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:19.821 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:19.822 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:20.000 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314019.539764_167.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:19.539764Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:40:20.000 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:40:20.001 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:40:20.002 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:20.003 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:20.004 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:20.082 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:20.083 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:20.244 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314019.539764_167.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:19.539764Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:40:20.244 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:40:20.295 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:20.296 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:20.296 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-13 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:20.337 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:20.339 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:20.532 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000003.8.9"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:40:20.533 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=mnwbfc-13 2021-07-26T15:40:20.533 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-13', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:20.534 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-13', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:20.534 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-13 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:20.578 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:20.579 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:20.762 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"90EnyKQtnVORRtktvJ3shqwb5lHv3sb","ns":""},"count":1},"inc_marker":{"position":"00000000002.6.10"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:40:20.763 WARNING:rgw_multi.tests:bucket mnwbfc-13 zone test-zone2 behind zone test-zone1: shard=5 master=00000000003.8.9 target=00000000002.6.10 2021-07-26T15:40:25.765 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-13', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:25.766 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-13', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:25.767 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-13 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:25.813 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:25.814 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:26.005 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"90EnyKQtnVORRtktvJ3shqwb5lHv3sb","ns":""},"count":1},"inc_marker":{"position":"00000000003.8.9"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:40:26.007 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=mnwbfc-13 2021-07-26T15:40:26.008 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:26.009 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:26.010 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-13 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:26.055 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:26.055 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:26.258 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000003.8.9"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:40:26.259 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-13 2021-07-26T15:40:26.259 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-13', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:26.260 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-13', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:26.261 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-13 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:26.305 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:26.305 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:26.496 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000003.8.9"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:40:26.497 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-13 2021-07-26T15:40:26.497 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-13', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:26.498 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-13', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:26.498 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-13 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:26.537 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:26.538 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:26.708 INFO:teuthology.orchestra.run.smithi197.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000002.7.10"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:40:26.709 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=mnwbfc-13 2021-07-26T15:40:26.710 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'mnwbfc-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:26.710 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'mnwbfc-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:26.711 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket mnwbfc-13 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:26.755 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:26.756 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:26.972 INFO:teuthology.orchestra.run.smithi183.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"90EnyKQtnVORRtktvJ3shqwb5lHv3sb","ns":""},"count":1},"inc_marker":{"position":"00000000002.7.10"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:40:26.973 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=mnwbfc-13 2021-07-26T15:40:26.973 INFO:tasks.rgw_multi.zone_rados:comparing bucket=mnwbfc-13 zones={test-zone2, test-zone1} 2021-07-26T15:40:26.982 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:40:27.035 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2021-07-26T15:40:27.036 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:40:27.043 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2021-07-26T15:40:27.100 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-07-26T15:40:27.113 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-07-26T15:40:27.180 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-07-26T15:40:27.244 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=mnwbfc-13 zones={test-zone2, test-zone1} 2021-07-26T15:40:28.303 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:28.304 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:28.304 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-13 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:28.344 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:28.345 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:28.521 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000003.8.9"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000033.82.8"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:40:28.522 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=mnwbfc-13 2021-07-26T15:40:28.522 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-13', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:28.523 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-13', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:28.523 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-13 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:28.572 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:28.573 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:28.756 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"90EnyKQtnVORRtktvJ3shqwb5lHv3sb","ns":""},"count":1},"inc_marker":{"position":"00000000003.8.9"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"ekPpTdjWn459iKpcTXTUE2fTYQH6iuL","ns":""},"count":1},"inc_marker":{"position":"00000000033.82.8"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:40:28.757 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=mnwbfc-13 2021-07-26T15:40:28.757 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:28.758 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:28.758 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-13 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:28.814 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:28.814 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:29.007 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000003.8.9"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000033.82.8"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:40:29.007 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-13 2021-07-26T15:40:29.008 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-13', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:29.008 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-13', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:29.009 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-13 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:29.053 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:29.053 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:29.248 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000003.8.9"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000033.82.8"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:40:29.248 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-13 2021-07-26T15:40:29.249 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-13', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:29.249 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-13', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:29.250 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-13 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:29.290 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:29.290 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:29.475 INFO:teuthology.orchestra.run.smithi197.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000002.7.10"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000038.90.11"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:40:29.475 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=mnwbfc-13 2021-07-26T15:40:29.476 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'mnwbfc-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:29.476 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'mnwbfc-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:29.477 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket mnwbfc-13 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:29.520 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:29.521 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:29.727 INFO:teuthology.orchestra.run.smithi183.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"90EnyKQtnVORRtktvJ3shqwb5lHv3sb","ns":""},"count":1},"inc_marker":{"position":"00000000002.7.10"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"osr9XVuIT5xBvMDXDx5AmBFGL38-CPH","ns":""},"count":1},"inc_marker":{"position":"00000000038.90.11"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:40:29.727 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=mnwbfc-13 2021-07-26T15:40:29.728 INFO:tasks.rgw_multi.zone_rados:comparing bucket=mnwbfc-13 zones={test-zone2, test-zone1} 2021-07-26T15:40:29.740 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:40:29.755 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2021-07-26T15:40:29.755 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:40:29.756 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:40:29.756 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:40:29.757 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:40:29.757 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:40:29.757 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:40:29.758 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:40:29.758 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:40:29.759 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:40:29.759 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:40:29.760 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:40:29.760 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:40:29.760 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:40:29.761 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:40:29.761 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:40:29.762 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:40:29.762 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:40:29.763 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:40:29.763 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:40:29.764 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:40:29.764 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:40:29.773 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2021-07-26T15:40:29.774 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:40:29.774 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:40:29.775 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:40:29.775 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:40:29.776 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:40:29.776 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:40:29.776 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:40:29.780 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:40:29.781 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:40:29.781 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:40:29.782 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:40:29.782 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:40:29.783 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:40:29.785 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:40:29.786 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:40:29.787 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:40:29.788 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:40:29.789 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:40:29.791 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:40:29.791 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:40:29.808 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-07-26T15:40:29.822 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-07-26T15:40:29.892 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-07-26T15:40:29.964 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:30.029 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:30.148 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:30.255 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:30.313 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:30.439 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:30.551 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:30.612 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:30.736 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:30.845 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:30.899 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:31.014 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:31.128 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:31.187 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:31.305 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:31.413 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:31.468 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:31.599 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:31.700 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:31.759 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:31.881 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:31.993 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:32.048 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:32.167 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:32.269 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:32.327 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:32.441 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:32.549 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:32.603 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:32.719 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:32.824 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:32.883 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:33.005 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:33.115 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:33.174 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:33.286 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:33.389 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:33.449 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:33.565 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:33.672 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:33.727 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:33.840 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:33.941 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:34.000 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:34.122 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:34.228 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:34.284 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:34.399 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:34.503 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:34.563 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:34.682 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:34.785 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:34.840 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:34.959 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:35.073 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:35.140 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:35.260 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:35.365 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:35.419 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:35.533 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:35.641 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=mnwbfc-13 zones={test-zone2, test-zone1} 2021-07-26T15:40:35.642 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:35.643 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:35.644 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:35.688 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:35.689 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:35.870 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"1_1627314031.129942_132.2","last_update":"2021-07-26T15:40:31.129942Z"},{"marker":"1_1627314031.129942_99.1","last_update":"2021-07-26T15:40:31.129942Z"},{"marker":"1_1627314031.129942_66.3","last_update":"2021-07-26T15:40:31.129942Z"},{"marker":"1_1627313997.711912_46.1","last_update":"2021-07-26T15:39:57.711912Z"}] 2021-07-26T15:40:35.871 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2021-07-26T15:40:35.871 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:35.872 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:35.873 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:35.916 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:35.917 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:36.089 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":18132629931907925738},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314031.129942_132.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:31.129942Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314027.264044_81.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:27.264044Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314031.129942_66.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:31.129942Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627313997.711912_46.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:39:57.711912Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T15:40:36.090 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=1 master=1_1627314031.129942_99.1 target=1_1627314027.264044_81.1 2021-07-26T15:40:41.091 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:41.218 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:41.219 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:41.262 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:41.262 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:41.453 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":18132629931907925738},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314031.129942_132.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:31.129942Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314031.129942_99.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:31.129942Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314031.129942_66.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:31.129942Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627313997.711912_46.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:39:57.711912Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T15:40:41.453 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2021-07-26T15:40:41.454 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:41.455 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:41.455 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:41.529 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:41.530 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:41.721 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"1_1627314031.129942_132.2","last_update":"2021-07-26T15:40:31.129942Z"},{"marker":"1_1627314031.129942_99.1","last_update":"2021-07-26T15:40:31.129942Z"},{"marker":"1_1627314031.129942_66.3","last_update":"2021-07-26T15:40:31.129942Z"},{"marker":"1_1627313997.711912_46.1","last_update":"2021-07-26T15:39:57.711912Z"}] 2021-07-26T15:40:41.722 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone3 source_zone=test-zone1 2021-07-26T15:40:41.723 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:41.724 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:41.725 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:41.769 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:41.769 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:41.934 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":3487142670906618468},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314031.129942_132.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:31.129942Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314031.129942_99.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:31.129942Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314031.129942_66.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:31.129942Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627313997.711912_46.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:39:57.711912Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T15:40:41.935 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone3 source_zone=test-zone1 2021-07-26T15:40:41.936 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:41.936 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:41.937 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:42.017 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:42.017 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:42.211 INFO:teuthology.orchestra.run.smithi197.stdout:[{"marker":"1_1627314031.274569_101.2","last_update":"2021-07-26T15:40:31.274569Z"},{"marker":"1_1627314031.274569_95.1","last_update":"2021-07-26T15:40:31.274569Z"},{"marker":"1_1627314031.274569_89.4","last_update":"2021-07-26T15:40:31.274569Z"},{"marker":"1_1627313997.581631_57.1","last_update":"2021-07-26T15:39:57.581631Z"}] 2021-07-26T15:40:42.212 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2021-07-26T15:40:42.213 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:42.214 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:42.234 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:42.278 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:42.279 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:42.483 INFO:teuthology.orchestra.run.smithi183.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":8875080199853872167},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314031.274569_101.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:31.274569Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314031.274569_95.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:31.274569Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314031.274569_89.4","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:31.274569Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627313997.581631_57.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:39:57.581631Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T15:40:42.483 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2021-07-26T15:40:42.484 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_concurrent_versioned_object_incremental_sync ... ok 2021-07-26T15:40:42.510 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:42.511 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:42.512 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:42.549 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:42.550 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:42.715 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=973db1f6-3ec7-4bde-a829-51b8cda6e0ef 2021-07-26T15:40:42.744 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"1_1627313858.513002_27.1","last_update":"2021-07-26T15:37:38.513002Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314042.513829_201.1","last_update":"2021-07-26T15:40:42.513829Z"},{"marker":"1_1627314002.183348_103.1","last_update":"2021-07-26T15:40:02.183348Z"}] 2021-07-26T15:40:42.745 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:40:42.745 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:42.746 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:42.746 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:42.801 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:42.801 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:42.952 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314042.513829_201.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:42.513829Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:40:42.957 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:40:42.960 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:40:42.960 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:42.961 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:42.962 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:43.010 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:43.010 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:43.175 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314042.513829_201.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:42.513829Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:40:43.176 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:40:43.235 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:43.236 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:43.237 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-14 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:43.279 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:43.283 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:43.470 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000001.4.5"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:40:43.471 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=mnwbfc-14 2021-07-26T15:40:43.472 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:43.473 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:43.473 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:43.519 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:43.519 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:43.705 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.4.5"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:40:43.706 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=mnwbfc-14 2021-07-26T15:40:43.707 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:43.708 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:43.708 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-14 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:43.751 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:43.754 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:43.958 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000001.4.5"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:40:43.958 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-14 2021-07-26T15:40:43.959 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:43.959 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:43.960 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:44.004 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:44.004 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:44.193 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.4.5"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:40:44.193 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-14 2021-07-26T15:40:44.194 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:44.194 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:44.195 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:44.275 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:44.275 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:44.459 INFO:teuthology.orchestra.run.smithi197.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000001.7.5"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:40:44.459 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=mnwbfc-14 2021-07-26T15:40:44.460 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'mnwbfc-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:44.460 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'mnwbfc-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:44.461 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket mnwbfc-14 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:44.501 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:44.501 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:44.701 INFO:teuthology.orchestra.run.smithi183.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.7.5"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:40:44.702 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=mnwbfc-14 2021-07-26T15:40:44.703 INFO:tasks.rgw_multi.zone_rados:comparing bucket=mnwbfc-14 zones={test-zone2, test-zone1} 2021-07-26T15:40:44.712 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:40:44.759 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:40:44.760 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:40:44.766 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:40:44.817 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:44.830 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:44.897 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:44.959 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=mnwbfc-14 zones={test-zone2, test-zone1} 2021-07-26T15:40:44.973 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:44.974 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:44.974 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:45.015 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:45.016 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:45.178 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=973db1f6-3ec7-4bde-a829-51b8cda6e0ef 2021-07-26T15:40:45.211 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"1_1627313858.513002_27.1","last_update":"2021-07-26T15:37:38.513002Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314044.975949_221.1","last_update":"2021-07-26T15:40:44.975949Z"},{"marker":"1_1627314002.183348_103.1","last_update":"2021-07-26T15:40:02.183348Z"}] 2021-07-26T15:40:45.211 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:40:45.212 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:45.213 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:45.213 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:45.253 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:45.253 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:45.426 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314044.975949_221.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:44.975949Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:40:45.427 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:40:45.428 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:40:45.428 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:45.429 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:45.430 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:45.507 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:45.508 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:45.679 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314044.975949_221.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:44.975949Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:40:45.680 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:40:45.731 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:45.732 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:45.732 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-14 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:45.773 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:45.773 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:45.984 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000003.7.12"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:40:45.984 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=mnwbfc-14 2021-07-26T15:40:45.985 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:45.986 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:45.987 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:46.051 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:46.051 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:46.242 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000003.7.12"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:40:46.243 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=mnwbfc-14 2021-07-26T15:40:46.244 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:46.244 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:46.245 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-14 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:46.292 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:46.292 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:46.473 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000003.7.12"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:40:46.474 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-14 2021-07-26T15:40:46.475 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:46.476 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:46.477 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:46.522 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:46.522 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:46.715 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000003.7.12"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:40:46.716 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-14 2021-07-26T15:40:46.717 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:46.718 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:46.719 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:46.762 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:46.762 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:46.931 INFO:teuthology.orchestra.run.smithi197.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000003.11.12"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:40:46.931 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=mnwbfc-14 2021-07-26T15:40:46.932 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'mnwbfc-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:46.933 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'mnwbfc-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:46.933 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket mnwbfc-14 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:46.979 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:46.979 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:47.205 INFO:teuthology.orchestra.run.smithi183.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000003.11.12"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:40:47.206 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=mnwbfc-14 2021-07-26T15:40:47.206 INFO:tasks.rgw_multi.zone_rados:comparing bucket=mnwbfc-14 zones={test-zone2, test-zone1} 2021-07-26T15:40:47.221 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:40:47.271 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:40:47.273 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:40:47.273 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:40:47.284 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:40:47.285 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:40:47.347 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:47.387 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:47.468 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:47.532 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:47.560 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:47.638 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:47.707 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=mnwbfc-14 zones={test-zone2, test-zone1} 2021-07-26T15:40:47.720 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:47.721 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:47.721 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:47.759 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:47.760 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:47.927 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=973db1f6-3ec7-4bde-a829-51b8cda6e0ef 2021-07-26T15:40:47.957 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"1_1627313858.513002_27.1","last_update":"2021-07-26T15:37:38.513002Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314047.723857_238.1","last_update":"2021-07-26T15:40:47.723857Z"},{"marker":"1_1627314002.183348_103.1","last_update":"2021-07-26T15:40:02.183348Z"}] 2021-07-26T15:40:47.958 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:40:47.959 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:47.959 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:47.960 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:48.000 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:48.001 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:48.180 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314047.723857_238.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:47.723857Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:40:48.180 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:40:48.181 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:40:48.181 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:48.182 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:48.182 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:48.264 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:48.265 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:48.441 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314047.723857_238.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:47.723857Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:40:48.442 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:40:48.491 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:48.492 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:48.493 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-14 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:48.537 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:48.537 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:48.725 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000005.11.17"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:40:48.725 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=mnwbfc-14 2021-07-26T15:40:48.726 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:48.727 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:48.727 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:48.773 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:48.777 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:48.958 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000005.11.17"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:40:48.959 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=mnwbfc-14 2021-07-26T15:40:48.961 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:48.961 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:48.962 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-14 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:49.010 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:49.011 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:49.221 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000005.11.17"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:40:49.222 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-14 2021-07-26T15:40:49.225 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:49.226 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:49.226 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:49.270 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:49.271 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:49.488 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000005.11.17"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:40:49.489 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-14 2021-07-26T15:40:49.489 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:49.490 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:49.493 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:49.533 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:49.533 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:49.709 INFO:teuthology.orchestra.run.smithi197.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000005.16.17"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:40:49.712 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=mnwbfc-14 2021-07-26T15:40:49.713 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'mnwbfc-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:49.713 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'mnwbfc-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:49.714 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket mnwbfc-14 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:49.757 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:49.758 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:49.975 INFO:teuthology.orchestra.run.smithi183.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000005.16.17"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:40:49.976 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=mnwbfc-14 2021-07-26T15:40:49.976 INFO:tasks.rgw_multi.zone_rados:comparing bucket=mnwbfc-14 zones={test-zone2, test-zone1} 2021-07-26T15:40:49.985 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:40:50.031 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:40:50.032 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:40:50.032 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:40:50.038 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:40:50.039 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:40:50.097 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:50.116 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:50.179 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:50.243 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:50.260 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:50.332 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:50.396 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=mnwbfc-14 zones={test-zone2, test-zone1} 2021-07-26T15:40:50.397 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_version_suspended_incremental_sync ... ok 2021-07-26T15:40:50.397 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=mnwbfc-15 2021-07-26T15:40:50.417 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=mnwbfc-16 2021-07-26T15:40:50.488 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:50.489 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:50.490 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:50.531 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:50.531 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:50.692 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=973db1f6-3ec7-4bde-a829-51b8cda6e0ef 2021-07-26T15:40:50.723 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"1_1627313858.513002_27.1","last_update":"2021-07-26T15:37:38.513002Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314050.489390_265.1","last_update":"2021-07-26T15:40:50.489390Z"},{"marker":"1_1627314002.183348_103.1","last_update":"2021-07-26T15:40:02.183348Z"}] 2021-07-26T15:40:50.724 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:40:50.725 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:50.725 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:50.726 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:50.762 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:50.762 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:50.940 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314050.489390_265.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:50.489390Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:40:50.940 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:40:50.941 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:40:50.941 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:50.942 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:50.942 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:51.027 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:51.027 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:51.200 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314050.489390_265.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:50.489390Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:40:51.200 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:40:51.350 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-15', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:51.352 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-15', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:51.353 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-15 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:51.394 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:51.395 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:51.601 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000003.9.11"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:40:51.602 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=mnwbfc-15 2021-07-26T15:40:51.602 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-15', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:51.603 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-15', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:51.604 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-15 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:51.647 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:51.648 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:51.816 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"pvWFidxOpUm04coc1.8tCnSkCa1DfMW","ns":""},"count":1},"inc_marker":{"position":"00000000003.9.11"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:40:51.817 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=mnwbfc-15 2021-07-26T15:40:51.818 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-15', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:51.818 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-15', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:51.819 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-15 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:51.859 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:51.860 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:52.047 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000003.9.11"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:40:52.048 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-15 2021-07-26T15:40:52.048 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-15', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:52.049 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-15', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:52.049 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-15 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:52.097 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:52.098 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:52.278 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000003.9.11"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:40:52.278 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-15 2021-07-26T15:40:52.279 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-15', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:52.279 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-15', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:52.280 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-15 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:52.319 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:52.320 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:52.503 INFO:teuthology.orchestra.run.smithi197.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000002.13.5"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:40:52.504 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=mnwbfc-15 2021-07-26T15:40:52.504 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'mnwbfc-15', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:52.505 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'mnwbfc-15', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:52.505 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket mnwbfc-15 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:52.553 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:52.554 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:52.753 INFO:teuthology.orchestra.run.smithi183.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"pvWFidxOpUm04coc1.8tCnSkCa1DfMW","ns":""},"count":1},"inc_marker":{"position":"00000000002.13.5"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:40:52.754 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=mnwbfc-15 2021-07-26T15:40:52.755 INFO:tasks.rgw_multi.zone_rados:comparing bucket=mnwbfc-15 zones={test-zone2, test-zone1} 2021-07-26T15:40:52.764 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:40:52.811 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:40:52.812 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:40:52.812 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:40:52.818 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:40:52.819 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:40:52.872 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:52.880 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:52.902 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:52.982 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=mnwbfc-15 zones={test-zone2, test-zone1} 2021-07-26T15:40:52.983 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-16', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:52.984 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-16', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:52.984 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-16 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:53.025 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:53.025 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:53.223 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000002.9.5"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:40:53.224 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=mnwbfc-16 2021-07-26T15:40:53.224 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-16', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:53.225 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-16', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:53.226 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-16 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:53.276 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:53.277 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:53.474 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"ydg0pKhVmfRFuMoNDQFd5Tn1RDVn9zm","ns":""},"count":1},"inc_marker":{"position":"00000000002.9.5"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:40:53.475 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=mnwbfc-16 2021-07-26T15:40:53.475 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-16', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:53.476 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-16', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:53.477 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-16 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:53.521 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:53.521 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:53.716 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000002.9.5"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:40:53.717 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-16 2021-07-26T15:40:53.717 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-16', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:53.718 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-16', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:53.718 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-16 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:53.764 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:53.764 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:53.943 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.9.5"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:40:53.944 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-16 2021-07-26T15:40:53.945 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-16', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:53.946 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-16', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:53.954 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-16 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:53.999 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:54.000 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:54.177 INFO:teuthology.orchestra.run.smithi197.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000003.18.11"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:40:54.178 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=mnwbfc-16 2021-07-26T15:40:54.178 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'mnwbfc-16', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:54.179 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'mnwbfc-16', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:54.180 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket mnwbfc-16 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:54.224 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:54.224 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:54.413 INFO:teuthology.orchestra.run.smithi183.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"ydg0pKhVmfRFuMoNDQFd5Tn1RDVn9zm","ns":""},"count":1},"inc_marker":{"position":"00000000003.18.11"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:40:54.413 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=mnwbfc-16 2021-07-26T15:40:54.414 INFO:tasks.rgw_multi.zone_rados:comparing bucket=mnwbfc-16 zones={test-zone2, test-zone1} 2021-07-26T15:40:54.433 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:40:54.483 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:40:54.484 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:40:54.485 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:40:54.500 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:40:54.501 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:40:54.571 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:54.598 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:54.611 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:54.688 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=mnwbfc-16 zones={test-zone2, test-zone1} 2021-07-26T15:40:54.689 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_delete_marker_full_sync ... ok 2021-07-26T15:40:54.690 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=mnwbfc-17 2021-07-26T15:40:54.720 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=mnwbfc-18 2021-07-26T15:40:54.819 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:54.820 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:54.822 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:54.862 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:54.864 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:55.016 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=973db1f6-3ec7-4bde-a829-51b8cda6e0ef 2021-07-26T15:40:55.045 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"1_1627313858.513002_27.1","last_update":"2021-07-26T15:37:38.513002Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314054.819047_302.1","last_update":"2021-07-26T15:40:54.819047Z"},{"marker":"1_1627314002.183348_103.1","last_update":"2021-07-26T15:40:02.183348Z"}] 2021-07-26T15:40:55.045 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:40:55.046 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:55.047 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:55.047 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:55.088 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:55.088 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:55.271 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314054.819047_302.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:54.819047Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:40:55.272 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:40:55.272 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:40:55.273 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:55.273 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:55.274 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:55.353 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:55.353 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:55.540 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314054.819047_302.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:54.819047Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:40:55.540 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:40:55.691 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-17', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:55.692 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-17', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:55.693 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-17 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:55.738 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:55.738 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:55.932 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000003.10.6"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:40:55.933 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=mnwbfc-17 2021-07-26T15:40:55.934 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:55.934 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:55.935 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:55.973 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:55.974 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:56.174 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"null","ns":""},"count":1},"inc_marker":{"position":"00000000003.10.6"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:40:56.175 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=mnwbfc-17 2021-07-26T15:40:56.175 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-17', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:56.176 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-17', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:56.176 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-17 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:56.226 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:56.233 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:56.400 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000003.10.6"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:40:56.401 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-17 2021-07-26T15:40:56.402 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:56.403 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:56.406 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:56.468 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:56.469 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:56.667 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000003.10.6"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:40:56.668 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-17 2021-07-26T15:40:56.669 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:56.682 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:56.683 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:56.756 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:56.757 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:56.939 INFO:teuthology.orchestra.run.smithi197.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000001.8.12"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:40:56.940 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=mnwbfc-17 2021-07-26T15:40:56.940 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'mnwbfc-17', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:56.941 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'mnwbfc-17', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:56.943 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket mnwbfc-17 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:56.993 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:56.993 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:57.192 INFO:teuthology.orchestra.run.smithi183.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"null","ns":""},"count":1},"inc_marker":{"position":"00000000001.8.12"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:40:57.193 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=mnwbfc-17 2021-07-26T15:40:57.193 INFO:tasks.rgw_multi.zone_rados:comparing bucket=mnwbfc-17 zones={test-zone2, test-zone1} 2021-07-26T15:40:57.202 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:40:57.260 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:40:57.261 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:40:57.266 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:40:57.320 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:57.332 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=mnwbfc-17 zones={test-zone2, test-zone1} 2021-07-26T15:40:57.333 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-18', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:57.333 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-18', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:57.334 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-18 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:57.378 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:57.378 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:57.556 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000001.9.12"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:40:57.556 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=mnwbfc-18 2021-07-26T15:40:57.557 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-18', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:57.557 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-18', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:57.558 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-18 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:57.602 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:57.604 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:57.796 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"null","ns":""},"count":1},"inc_marker":{"position":"00000000001.9.12"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:40:57.796 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=mnwbfc-18 2021-07-26T15:40:57.798 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-18', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:57.798 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-18', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:57.799 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-18 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:57.839 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:57.839 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:58.027 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000001.9.12"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:40:58.028 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-18 2021-07-26T15:40:58.028 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-18', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:58.029 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-18', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:58.029 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-18 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:58.079 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:58.079 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:58.275 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.9.12"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:40:58.275 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-18 2021-07-26T15:40:58.276 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-18', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:58.276 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-18', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:58.277 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-18 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:58.357 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:58.358 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:58.557 INFO:teuthology.orchestra.run.smithi197.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000003.20.6"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:40:58.558 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=mnwbfc-18 2021-07-26T15:40:58.559 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'mnwbfc-18', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:58.560 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'mnwbfc-18', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:40:58.561 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket mnwbfc-18 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:40:58.606 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:40:58.606 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:40:58.801 INFO:teuthology.orchestra.run.smithi183.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"null","ns":""},"count":1},"inc_marker":{"position":"00000000003.20.6"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:40:58.802 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=mnwbfc-18 2021-07-26T15:40:58.802 INFO:tasks.rgw_multi.zone_rados:comparing bucket=mnwbfc-18 zones={test-zone2, test-zone1} 2021-07-26T15:40:58.811 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:40:58.863 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:40:58.864 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:40:58.869 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:40:58.921 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:40:58.927 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=mnwbfc-18 zones={test-zone2, test-zone1} 2021-07-26T15:40:58.928 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_suspended_delete_marker_full_sync ... ok 2021-07-26T15:40:58.929 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=mnwbfc-19 2021-07-26T15:40:58.960 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=mnwbfc-20 2021-07-26T15:40:59.127 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_versioning ... ok 2021-07-26T15:40:59.128 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=mnwbfc-21 2021-07-26T15:40:59.154 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=mnwbfc-22 2021-07-26T15:40:59.331 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_acl ... ok 2021-07-26T15:40:59.332 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=mnwbfc-23 2021-07-26T15:40:59.359 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=mnwbfc-24 2021-07-26T15:41:00.523 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_cors ... ok 2021-07-26T15:41:00.524 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=mnwbfc-25 2021-07-26T15:41:00.559 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=mnwbfc-26 2021-07-26T15:41:00.605 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:41:00.605 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:41:00.606 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:41:00.643 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:41:00.644 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:41:00.802 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=973db1f6-3ec7-4bde-a829-51b8cda6e0ef 2021-07-26T15:41:00.831 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"1_1627313858.513002_27.1","last_update":"2021-07-26T15:37:38.513002Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314060.591810_369.1","last_update":"2021-07-26T15:41:00.591810Z"},{"marker":"1_1627314002.183348_103.1","last_update":"2021-07-26T15:40:02.183348Z"}] 2021-07-26T15:41:00.832 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:41:00.833 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:41:00.833 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:41:00.834 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:41:00.875 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:41:00.876 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:41:01.067 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314060.591810_369.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:41:00.591810Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:41:01.068 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:41:01.069 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:41:01.069 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:41:01.075 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:41:01.076 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:41:01.159 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:41:01.159 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:41:01.349 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314060.591810_369.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:41:00.591810Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:41:01.350 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:41:01.593 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_delete_notempty ... ok 2021-07-26T15:41:01.595 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=mnwbfc-27 2021-07-26T15:41:01.625 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=mnwbfc-28 2021-07-26T15:41:01.670 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:41:01.671 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:41:01.671 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:41:01.718 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:41:01.719 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:41:01.867 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=973db1f6-3ec7-4bde-a829-51b8cda6e0ef 2021-07-26T15:41:01.901 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"1_1627313858.513002_27.1","last_update":"2021-07-26T15:37:38.513002Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314061.657210_380.1","last_update":"2021-07-26T15:41:01.657210Z"},{"marker":"1_1627314002.183348_103.1","last_update":"2021-07-26T15:40:02.183348Z"}] 2021-07-26T15:41:01.901 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:41:01.902 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:41:01.902 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:41:01.903 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:41:01.942 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:41:01.943 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:41:02.142 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314061.657210_380.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:41:01.657210Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:41:02.143 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:41:02.143 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:41:02.144 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:41:02.144 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:41:02.145 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:41:02.231 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:41:02.232 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:41:02.423 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314061.657210_380.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:41:01.657210Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:41:02.424 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:41:02.425 DEBUG:tasks.rgw.c2.client.1:waiting for process to exit 2021-07-26T15:41:02.426 INFO:teuthology.orchestra.run:waiting for 300 2021-07-26T15:41:02.427 INFO:tasks.rgw.c2.client.1.smithi197.stdout:2021-07-26T15:41:02.426+0000 7f76ca7fc700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=8001 -n client.1 --cluster c2 -k /etc/ceph/c2.client.1.keyring --log-file /var/log/ceph/rgw.c2.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.1.sock --foreground --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm (PID: 18481) UID: 0 2021-07-26T15:41:02.430 INFO:tasks.rgw.c2.client.1.smithi197.stdout:2021-07-26T15:41:02.426+0000 7f76db041980 -1 shutting down 2021-07-26T15:41:05.454 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.1 is failed for ~0s 2021-07-26T15:41:08.535 INFO:tasks.rgw.c2.client.1:Stopped 2021-07-26T15:41:08.536 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--master', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:41:08.537 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--master', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:41:08.537 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone modify --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --master --cluster c2 --debug-rgw 0 --debug-ms 0 2021-07-26T15:41:08.576 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:41:08.577 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:41:08.601 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:41:08.602+0000 7f087a4da980 0 NOTICE: overriding master zone: fdbd535a-3fb6-49cb-8b49-68faf14e40fe 2021-07-26T15:41:08.621 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:41:08.606+0000 7f087a4da980 0 failed reading obj info from .rgw.root:zone_info.fdbd535a-3fb6-49cb-8b49-68faf14e40fe: (2) No such file or directory 2021-07-26T15:41:08.622 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:41:08.606+0000 7f087a4da980 0 WARNING: could not read zone params for zone id=fdbd535a-3fb6-49cb-8b49-68faf14e40fe name=test-zone1 2021-07-26T15:41:08.625 INFO:teuthology.orchestra.run.smithi197.stdout:{"id":"1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d","name":"test-zone2","domain_root":"test-zone2.rgw.meta:root","control_pool":"test-zone2.rgw.control","gc_pool":"test-zone2.rgw.log:gc","lc_pool":"test-zone2.rgw.log:lc","log_pool":"test-zone2.rgw.log","intent_log_pool":"test-zone2.rgw.log:intent","usage_log_pool":"test-zone2.rgw.log:usage","roles_pool":"test-zone2.rgw.meta:roles","reshard_pool":"test-zone2.rgw.log:reshard","user_keys_pool":"test-zone2.rgw.meta:users.keys","user_email_pool":"test-zone2.rgw.meta:users.email","user_swift_pool":"test-zone2.rgw.meta:users.swift","user_uid_pool":"test-zone2.rgw.meta:users.uid","otp_pool":"test-zone2.rgw.otp","system_key":{"access_key":"ZVEPLG55FHAYZUFC","secret_key":"fSeMFeFOakj53SxFrtZZrsnDzPpkESXF"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone2.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone2.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone2.rgw.buckets.non-ec","index_type":0}}],"realm_id":"d1743e17-c3cb-4823-84fd-b11c05487344"} 2021-07-26T15:41:08.626 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:41:08.626 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:41:08.627 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2021-07-26T15:41:08.704 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:41:08.704 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:41:08.954 INFO:teuthology.orchestra.run.smithi197.stdout:{"id":"32f6ee58-702f-42e6-a264-989c7d3e6f45","epoch":1,"predecessor_uuid":"973db1f6-3ec7-4bde-a829-51b8cda6e0ef","sync_status":["1_1627313858.513002_27.1","","1_1627314061.657210_380.1","1_1627314002.183348_103.1"],"period_map":{"id":"32f6ee58-702f-42e6-a264-989c7d3e6f45","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://smithi183.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d","zones":[{"id":"1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d","name":"test-zone2","endpoints":["http://smithi197.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"279e5f25-fca9-4d30-8a59-b5dbb281c553","name":"test-zone3","endpoints":["http://smithi197.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""},{"id":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe","name":"test-zone1","endpoints":["http://smithi183.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"d1743e17-c3cb-4823-84fd-b11c05487344","sync_policy":{"groups":[]}}],"short_zone_ids":[{"key":"1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d","val":841289883},{"key":"279e5f25-fca9-4d30-8a59-b5dbb281c553","val":1085791465},{"key":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe","val":2260121961}]},"master_zonegroup":"test-zonegroup","master_zone":"1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"d1743e17-c3cb-4823-84fd-b11c05487344","realm_name":"test-realm","realm_epoch":3} 2021-07-26T15:41:08.955 INFO:rgw_multi.tests:Set master zone=test-zone2, waiting 60s for reconfiguration.. 2021-07-26T15:41:11.059 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.1 has been restored 2021-07-26T15:42:08.956 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=mnwbfc-29 2021-07-26T15:42:09.016 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=mnwbfc-30 2021-07-26T15:42:09.049 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:42:09.049 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:42:09.050 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:42:09.106 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:42:09.107 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:42:09.251 INFO:teuthology.orchestra.run.smithi197.stderr:No --period given, using current period=32f6ee58-702f-42e6-a264-989c7d3e6f45 2021-07-26T15:42:09.287 INFO:teuthology.orchestra.run.smithi197.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314129.051612_142.1","last_update":"2021-07-26T15:42:09.051612Z"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:42:09.288 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone1 2021-07-26T15:42:09.289 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:42:09.290 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:42:09.295 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:42:09.340 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:42:09.340 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:42:09.525 INFO:teuthology.orchestra.run.smithi183.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"32f6ee58-702f-42e6-a264-989c7d3e6f45","realm_epoch":3},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":55,"pos":0,"timestamp":"0.000000","realm_epoch":3}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":3}},{"key":2,"val":{"state":1,"marker":"1_1627314129.051612_142.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:42:09.051612Z","realm_epoch":3}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":3}}]},"full_sync":{"total":55,"complete":55}} 2021-07-26T15:42:09.525 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone1 2021-07-26T15:42:09.526 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'modify', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--master', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:42:09.526 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'modify', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--master', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:42:09.527 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone modify --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --master --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:42:09.565 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:42:09.566 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:42:09.592 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:42:09.593+0000 7f7ffebc4980 0 NOTICE: overriding master zone: 1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d 2021-07-26T15:42:09.595 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:42:09.593+0000 7f7ffebc4980 0 failed reading obj info from .rgw.root:zone_info.1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d: (2) No such file or directory 2021-07-26T15:42:09.596 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:42:09.593+0000 7f7ffebc4980 0 WARNING: could not read zone params for zone id=1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d name=test-zone2 2021-07-26T15:42:09.596 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:42:09.597+0000 7f7ffebc4980 0 failed reading obj info from .rgw.root:zone_info.279e5f25-fca9-4d30-8a59-b5dbb281c553: (2) No such file or directory 2021-07-26T15:42:09.596 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:42:09.597+0000 7f7ffebc4980 0 WARNING: could not read zone params for zone id=279e5f25-fca9-4d30-8a59-b5dbb281c553 name=test-zone3 2021-07-26T15:42:09.609 INFO:teuthology.orchestra.run.smithi183.stdout:{"id":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe","name":"test-zone1","domain_root":"test-zone1.rgw.meta:root","control_pool":"test-zone1.rgw.control","gc_pool":"test-zone1.rgw.log:gc","lc_pool":"test-zone1.rgw.log:lc","log_pool":"test-zone1.rgw.log","intent_log_pool":"test-zone1.rgw.log:intent","usage_log_pool":"test-zone1.rgw.log:usage","roles_pool":"test-zone1.rgw.meta:roles","reshard_pool":"test-zone1.rgw.log:reshard","user_keys_pool":"test-zone1.rgw.meta:users.keys","user_email_pool":"test-zone1.rgw.meta:users.email","user_swift_pool":"test-zone1.rgw.meta:users.swift","user_uid_pool":"test-zone1.rgw.meta:users.uid","otp_pool":"test-zone1.rgw.otp","system_key":{"access_key":"ZVEPLG55FHAYZUFC","secret_key":"fSeMFeFOakj53SxFrtZZrsnDzPpkESXF"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone1.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone1.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone1.rgw.buckets.non-ec","index_type":0}}],"realm_id":"d1743e17-c3cb-4823-84fd-b11c05487344"} 2021-07-26T15:42:09.610 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:42:09.611 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:42:09.618 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 period update --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:42:09.691 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:42:09.691 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:42:09.943 INFO:teuthology.orchestra.run.smithi183.stdout:{"id":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","epoch":1,"predecessor_uuid":"32f6ee58-702f-42e6-a264-989c7d3e6f45","sync_status":["","","1_1627314129.051612_142.1",""],"period_map":{"id":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://smithi183.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe","zones":[{"id":"1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d","name":"test-zone2","endpoints":["http://smithi197.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"279e5f25-fca9-4d30-8a59-b5dbb281c553","name":"test-zone3","endpoints":["http://smithi197.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""},{"id":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe","name":"test-zone1","endpoints":["http://smithi183.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"d1743e17-c3cb-4823-84fd-b11c05487344","sync_policy":{"groups":[]}}],"short_zone_ids":[{"key":"1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d","val":841289883},{"key":"279e5f25-fca9-4d30-8a59-b5dbb281c553","val":1085791465},{"key":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe","val":2260121961}]},"master_zonegroup":"test-zonegroup","master_zone":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"d1743e17-c3cb-4823-84fd-b11c05487344","realm_name":"test-realm","realm_epoch":4} 2021-07-26T15:42:09.944 INFO:rgw_multi.tests:Set master zone=test-zone1, waiting 60s for reconfiguration.. 2021-07-26T15:43:09.946 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=mnwbfc-31 2021-07-26T15:43:09.980 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=mnwbfc-32 2021-07-26T15:43:10.034 INFO:tasks.rgw.c2.client.1:Restarting daemon 2021-07-26T15:43:10.035 DEBUG:teuthology.orchestra.run.smithi197:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8001' -n client.1 --cluster c2 -k /etc/ceph/c2.client.1.keyring --log-file /var/log/ceph/rgw.c2.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.1.sock --foreground --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c2.client.1.stdout 2>&1 2021-07-26T15:43:10.038 INFO:tasks.rgw.c2.client.1:Started 2021-07-26T15:43:10.039 DEBUG:teuthology.orchestra.run.smithi197:> curl http://smithi197.front.sepia.ceph.com:8001 2021-07-26T15:43:10.057 DEBUG:teuthology.orchestra.run:got remote process result: 7 2021-07-26T15:43:10.058 INFO:teuthology.orchestra.run.smithi197.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-07-26T15:43:10.058 INFO:teuthology.orchestra.run.smithi197.stderr: Dload Upload Total Spent Left Speed 2021-07-26T15:43:10.058 INFO:teuthology.orchestra.run.smithi197.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2021-07-26T15:43:10.058 INFO:teuthology.orchestra.run.smithi197.stderr:curl: (7) Failed to connect to smithi197.front.sepia.ceph.com port 8001: Connection refused 2021-07-26T15:43:11.061 DEBUG:teuthology.orchestra.run.smithi197:> curl http://smithi197.front.sepia.ceph.com:8001 2021-07-26T15:43:11.082 INFO:teuthology.orchestra.run.smithi197.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-07-26T15:43:11.083 INFO:teuthology.orchestra.run.smithi197.stderr: Dload Upload Total Spent Left Speed 2021-07-26T15:43:11.083 INFO:teuthology.orchestra.run.smithi197.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 134 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 134 100 134 0 0 130k 0 --:--:-- --:--:-- --:--:-- 67000 2021-07-26T15:43:11.085 INFO:teuthology.orchestra.run.smithi197.stdout:{"Code":"MethodNotAllowed","RequestId":"tx000000000000000000001-0060fed80f-13bb-test-zone3","HostId":"13bb-test-zone3-test-zonegroup"} 2021-07-26T15:43:11.086 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:11.087 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:11.087 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:43:11.130 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:43:11.130 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:43:11.290 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=816a1f73-b2bd-4f0e-a507-b6c39ba8a110 2021-07-26T15:43:11.320 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314190.011527_134.1","last_update":"2021-07-26T15:43:10.011527Z"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:43:11.320 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:43:11.321 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:11.321 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:11.322 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:43:11.360 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:43:11.361 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:43:11.546 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314190.011527_134.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:43:10.011527Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:43:11.547 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:43:11.547 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:43:11.548 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:11.548 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:11.549 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:43:11.587 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:43:11.589 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:43:11.778 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314190.011527_134.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:43:10.011527Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:43:11.778 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:43:11.779 INFO:tasks.rgw_multi.zone_rados:comparing bucket=mnwbfc-27 zones={test-zone2, test-zone1} 2021-07-26T15:43:11.793 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:43:11.839 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:43:11.895 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=mnwbfc-27 zones={test-zone2, test-zone1} 2021-07-26T15:43:11.896 INFO:tasks.rgw_multi.zone_rados:comparing bucket=mnwbfc-27 zones={test-zone1, test-zone2} 2021-07-26T15:43:11.904 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:43:11.951 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:43:12.007 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=mnwbfc-27 zones={test-zone1, test-zone2} 2021-07-26T15:43:12.008 INFO:tasks.rgw_multi.zone_rados:comparing bucket=mnwbfc-28 zones={test-zone2, test-zone1} 2021-07-26T15:43:12.019 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:43:12.063 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:43:12.120 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=mnwbfc-28 zones={test-zone2, test-zone1} 2021-07-26T15:43:12.121 INFO:tasks.rgw_multi.zone_rados:comparing bucket=mnwbfc-28 zones={test-zone1, test-zone2} 2021-07-26T15:43:12.129 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:43:12.175 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:43:12.232 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=mnwbfc-28 zones={test-zone1, test-zone2} 2021-07-26T15:43:12.233 INFO:tasks.rgw_multi.zone_rados:comparing bucket=mnwbfc-29 zones={test-zone2, test-zone1} 2021-07-26T15:43:12.242 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:43:12.291 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:43:12.348 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=mnwbfc-29 zones={test-zone2, test-zone1} 2021-07-26T15:43:12.349 INFO:tasks.rgw_multi.zone_rados:comparing bucket=mnwbfc-29 zones={test-zone1, test-zone2} 2021-07-26T15:43:12.357 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:43:12.407 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:43:12.465 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=mnwbfc-29 zones={test-zone1, test-zone2} 2021-07-26T15:43:12.465 INFO:tasks.rgw_multi.zone_rados:comparing bucket=mnwbfc-30 zones={test-zone2, test-zone1} 2021-07-26T15:43:12.474 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:43:12.523 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:43:12.580 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=mnwbfc-30 zones={test-zone2, test-zone1} 2021-07-26T15:43:12.581 INFO:tasks.rgw_multi.zone_rados:comparing bucket=mnwbfc-30 zones={test-zone1, test-zone2} 2021-07-26T15:43:12.590 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:43:12.639 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:43:12.700 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=mnwbfc-30 zones={test-zone1, test-zone2} 2021-07-26T15:43:12.701 INFO:tasks.rgw_multi.zone_rados:comparing bucket=mnwbfc-31 zones={test-zone2, test-zone1} 2021-07-26T15:43:12.711 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:43:12.759 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:43:12.817 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=mnwbfc-31 zones={test-zone2, test-zone1} 2021-07-26T15:43:12.817 INFO:tasks.rgw_multi.zone_rados:comparing bucket=mnwbfc-31 zones={test-zone1, test-zone2} 2021-07-26T15:43:12.826 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:43:12.875 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:43:12.936 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=mnwbfc-31 zones={test-zone1, test-zone2} 2021-07-26T15:43:12.937 INFO:tasks.rgw_multi.zone_rados:comparing bucket=mnwbfc-32 zones={test-zone2, test-zone1} 2021-07-26T15:43:12.946 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:43:12.991 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:43:13.056 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=mnwbfc-32 zones={test-zone2, test-zone1} 2021-07-26T15:43:13.057 INFO:tasks.rgw_multi.zone_rados:comparing bucket=mnwbfc-32 zones={test-zone1, test-zone2} 2021-07-26T15:43:13.066 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:43:13.111 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:43:13.168 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=mnwbfc-32 zones={test-zone1, test-zone2} 2021-07-26T15:43:13.169 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'list', '--period', '973db1f6-3ec7-4bde-a829-51b8cda6e0ef', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:13.169 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'list', '--period', '973db1f6-3ec7-4bde-a829-51b8cda6e0ef', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:13.170 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog list --period 973db1f6-3ec7-4bde-a829-51b8cda6e0ef --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:43:13.209 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:43:13.209 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:43:13.404 INFO:teuthology.orchestra.run.smithi183.stdout:[{"id":"1_1627313858.507995_25.1","section":"user","name":"rgw-multisite-test-user","timestamp":"2021-07-26T15:37:38.507995204Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6LjJeV9FVE82AHmvNh9bR46","ver":1},"status":{"status":"write"}}},{"id":"1_1627313858.513002_27.1","section":"user","name":"rgw-multisite-test-user","timestamp":"2021-07-26T15:37:38.513002270Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6LjJeV9FVE82AHmvNh9bR46","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314002.202497_41.1","section":"bucket.instance","name":"mnwbfc-10:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.14","timestamp":"2021-07-26T15:40:02.202497340Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_jH5FXSbDBvszJXegnF39XmK","ver":1},"status":{"status":"write"}}},{"id":"1_1627314002.208118_78.1","section":"bucket.instance","name":"mnwbfc-10:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.14","timestamp":"2021-07-26T15:40:02.208118599Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_jH5FXSbDBvszJXegnF39XmK","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314002.209953_79.1","section":"bucket","name":"mnwbfc-10","timestamp":"2021-07-26T15:40:02.209953787Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_pocZF6RV4psUMhk_fZ8vA1G","ver":1},"status":{"status":"write"}}},{"id":"1_1627314002.214845_80.1","section":"bucket","name":"mnwbfc-10","timestamp":"2021-07-26T15:40:02.214845795Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_pocZF6RV4psUMhk_fZ8vA1G","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314007.101113_81.1","section":"bucket.instance","name":"mnwbfc-11:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.15","timestamp":"2021-07-26T15:40:07.101113386Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_yLcBdkk0fweVDuxSnvodLeC","ver":1},"status":{"status":"write"}}},{"id":"1_1627314007.105691_103.1","section":"bucket.instance","name":"mnwbfc-11:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.15","timestamp":"2021-07-26T15:40:07.105691675Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_yLcBdkk0fweVDuxSnvodLeC","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314007.107158_104.1","section":"bucket","name":"mnwbfc-11","timestamp":"2021-07-26T15:40:07.107158515Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_vk334tlGU48YuGrMSNVJZ-z","ver":1},"status":{"status":"write"}}},{"id":"1_1627314007.111070_105.1","section":"bucket","name":"mnwbfc-11","timestamp":"2021-07-26T15:40:07.111070992Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_vk334tlGU48YuGrMSNVJZ-z","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314007.127186_106.1","section":"bucket.instance","name":"mnwbfc-12:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.16","timestamp":"2021-07-26T15:40:07.127186559Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_e4odE9Am_PbvS7yGyBRjKkA","ver":1},"status":{"status":"write"}}},{"id":"1_1627314007.131931_107.1","section":"bucket.instance","name":"mnwbfc-12:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.16","timestamp":"2021-07-26T15:40:07.131931179Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_e4odE9Am_PbvS7yGyBRjKkA","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314007.133761_108.1","section":"bucket","name":"mnwbfc-12","timestamp":"2021-07-26T15:40:07.133761612Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_EQvmtwQRBep0Y7OZGtEfMix","ver":1},"status":{"status":"write"}}},{"id":"1_1627314007.139113_109.1","section":"bucket","name":"mnwbfc-12","timestamp":"2021-07-26T15:40:07.139113296Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_EQvmtwQRBep0Y7OZGtEfMix","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314007.164399_110.1","section":"bucket.instance","name":"mnwbfc-11:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.15","timestamp":"2021-07-26T15:40:07.164399541Z","data":{"read_version":{"tag":"_yLcBdkk0fweVDuxSnvodLeC","ver":1},"write_version":{"tag":"_yLcBdkk0fweVDuxSnvodLeC","ver":2},"status":{"status":"write"}}},{"id":"1_1627314007.171304_111.1","section":"bucket.instance","name":"mnwbfc-11:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.15","timestamp":"2021-07-26T15:40:07.171304049Z","data":{"read_version":{"tag":"_yLcBdkk0fweVDuxSnvodLeC","ver":1},"write_version":{"tag":"_yLcBdkk0fweVDuxSnvodLeC","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314007.177229_112.1","section":"bucket.instance","name":"mnwbfc-12:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.16","timestamp":"2021-07-26T15:40:07.177229849Z","data":{"read_version":{"tag":"_e4odE9Am_PbvS7yGyBRjKkA","ver":1},"write_version":{"tag":"_e4odE9Am_PbvS7yGyBRjKkA","ver":2},"status":{"status":"write"}}},{"id":"1_1627314007.183769_113.1","section":"bucket.instance","name":"mnwbfc-12:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.16","timestamp":"2021-07-26T15:40:07.183769887Z","data":{"read_version":{"tag":"_e4odE9Am_PbvS7yGyBRjKkA","ver":1},"write_version":{"tag":"_e4odE9Am_PbvS7yGyBRjKkA","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314019.513680_114.1","section":"bucket.instance","name":"mnwbfc-13:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.17","timestamp":"2021-07-26T15:40:19.513680358Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_VBFkjsQ5Ef7fuHh8lWr9ncS","ver":1},"status":{"status":"write"}}},{"id":"1_1627314019.519356_163.1","section":"bucket.instance","name":"mnwbfc-13:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.17","timestamp":"2021-07-26T15:40:19.519356702Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_VBFkjsQ5Ef7fuHh8lWr9ncS","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314019.521188_164.1","section":"bucket","name":"mnwbfc-13","timestamp":"2021-07-26T15:40:19.521188191Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_LPlYfw1E8YhiiIUwePogHvO","ver":1},"status":{"status":"write"}}},{"id":"1_1627314019.526593_165.1","section":"bucket","name":"mnwbfc-13","timestamp":"2021-07-26T15:40:19.526593055Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_LPlYfw1E8YhiiIUwePogHvO","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314019.533381_166.1","section":"bucket.instance","name":"mnwbfc-13:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.17","timestamp":"2021-07-26T15:40:19.533381506Z","data":{"read_version":{"tag":"_VBFkjsQ5Ef7fuHh8lWr9ncS","ver":1},"write_version":{"tag":"_VBFkjsQ5Ef7fuHh8lWr9ncS","ver":2},"status":{"status":"write"}}},{"id":"1_1627314019.539764_167.1","section":"bucket.instance","name":"mnwbfc-13:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.17","timestamp":"2021-07-26T15:40:19.539764629Z","data":{"read_version":{"tag":"_VBFkjsQ5Ef7fuHh8lWr9ncS","ver":1},"write_version":{"tag":"_VBFkjsQ5Ef7fuHh8lWr9ncS","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314042.503842_168.1","section":"bucket.instance","name":"mnwbfc-14:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.18","timestamp":"2021-07-26T15:40:42.503842215Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_EtxRYHr1FqzG9ewQewiD2h4","ver":1},"status":{"status":"write"}}},{"id":"1_1627314042.508569_199.1","section":"bucket.instance","name":"mnwbfc-14:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.18","timestamp":"2021-07-26T15:40:42.508569366Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_EtxRYHr1FqzG9ewQewiD2h4","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314042.510073_200.1","section":"bucket","name":"mnwbfc-14","timestamp":"2021-07-26T15:40:42.510073204Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_t-vTV2WhTSH06d8_q8RPhqT","ver":1},"status":{"status":"write"}}},{"id":"1_1627314042.513829_201.1","section":"bucket","name":"mnwbfc-14","timestamp":"2021-07-26T15:40:42.513829898Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_t-vTV2WhTSH06d8_q8RPhqT","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314044.968708_214.1","section":"bucket.instance","name":"mnwbfc-14:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.18","timestamp":"2021-07-26T15:40:44.968708542Z","data":{"read_version":{"tag":"_EtxRYHr1FqzG9ewQewiD2h4","ver":1},"write_version":{"tag":"_EtxRYHr1FqzG9ewQewiD2h4","ver":2},"status":{"status":"write"}}},{"id":"1_1627314044.975949_221.1","section":"bucket.instance","name":"mnwbfc-14:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.18","timestamp":"2021-07-26T15:40:44.975949254Z","data":{"read_version":{"tag":"_EtxRYHr1FqzG9ewQewiD2h4","ver":1},"write_version":{"tag":"_EtxRYHr1FqzG9ewQewiD2h4","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314047.717788_228.1","section":"bucket.instance","name":"mnwbfc-14:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.18","timestamp":"2021-07-26T15:40:47.717788491Z","data":{"read_version":{"tag":"_EtxRYHr1FqzG9ewQewiD2h4","ver":2},"write_version":{"tag":"_EtxRYHr1FqzG9ewQewiD2h4","ver":3},"status":{"status":"write"}}},{"id":"1_1627314047.723857_238.1","section":"bucket.instance","name":"mnwbfc-14:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.18","timestamp":"2021-07-26T15:40:47.723857922Z","data":{"read_version":{"tag":"_EtxRYHr1FqzG9ewQewiD2h4","ver":2},"write_version":{"tag":"_EtxRYHr1FqzG9ewQewiD2h4","ver":3},"status":{"status":"complete"}}},{"id":"1_1627314050.412473_248.1","section":"bucket.instance","name":"mnwbfc-15:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.19","timestamp":"2021-07-26T15:40:50.412473220Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_TOrw69_N-l7EXnS9m_Qs-Sq","ver":1},"status":{"status":"write"}}},{"id":"1_1627314050.416323_255.1","section":"bucket.instance","name":"mnwbfc-15:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.19","timestamp":"2021-07-26T15:40:50.416323128Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_TOrw69_N-l7EXnS9m_Qs-Sq","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314050.417793_256.1","section":"bucket","name":"mnwbfc-15","timestamp":"2021-07-26T15:40:50.417793587Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_qjneeS_m0Zl9-0tTONz3yFt","ver":1},"status":{"status":"write"}}},{"id":"1_1627314050.421539_257.1","section":"bucket","name":"mnwbfc-15","timestamp":"2021-07-26T15:40:50.421539967Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_qjneeS_m0Zl9-0tTONz3yFt","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314050.437822_258.1","section":"bucket.instance","name":"mnwbfc-16:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.20","timestamp":"2021-07-26T15:40:50.437822429Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_NfZn_StQ13Uw4JGOJME3UYG","ver":1},"status":{"status":"write"}}},{"id":"1_1627314050.443081_259.1","section":"bucket.instance","name":"mnwbfc-16:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.20","timestamp":"2021-07-26T15:40:50.443081316Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_NfZn_StQ13Uw4JGOJME3UYG","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314050.444947_260.1","section":"bucket","name":"mnwbfc-16","timestamp":"2021-07-26T15:40:50.444947344Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_WUM8uLjqrGSCGHYj3vNqU6w","ver":1},"status":{"status":"write"}}},{"id":"1_1627314050.449052_261.1","section":"bucket","name":"mnwbfc-16","timestamp":"2021-07-26T15:40:50.449052278Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_WUM8uLjqrGSCGHYj3vNqU6w","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314050.471159_262.1","section":"bucket.instance","name":"mnwbfc-15:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.19","timestamp":"2021-07-26T15:40:50.471159562Z","data":{"read_version":{"tag":"_TOrw69_N-l7EXnS9m_Qs-Sq","ver":1},"write_version":{"tag":"_TOrw69_N-l7EXnS9m_Qs-Sq","ver":2},"status":{"status":"write"}}},{"id":"1_1627314050.477155_263.1","section":"bucket.instance","name":"mnwbfc-15:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.19","timestamp":"2021-07-26T15:40:50.477155576Z","data":{"read_version":{"tag":"_TOrw69_N-l7EXnS9m_Qs-Sq","ver":1},"write_version":{"tag":"_TOrw69_N-l7EXnS9m_Qs-Sq","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314050.482723_264.1","section":"bucket.instance","name":"mnwbfc-16:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.20","timestamp":"2021-07-26T15:40:50.482723843Z","data":{"read_version":{"tag":"_NfZn_StQ13Uw4JGOJME3UYG","ver":1},"write_version":{"tag":"_NfZn_StQ13Uw4JGOJME3UYG","ver":2},"status":{"status":"write"}}},{"id":"1_1627314050.489390_265.1","section":"bucket.instance","name":"mnwbfc-16:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.20","timestamp":"2021-07-26T15:40:50.489390895Z","data":{"read_version":{"tag":"_NfZn_StQ13Uw4JGOJME3UYG","ver":1},"write_version":{"tag":"_NfZn_StQ13Uw4JGOJME3UYG","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314054.709441_266.1","section":"bucket.instance","name":"mnwbfc-17:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.21","timestamp":"2021-07-26T15:40:54.709441412Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_YIg4ILQxrRsVv3nMNdny4tQ","ver":1},"status":{"status":"write"}}},{"id":"1_1627314054.715356_288.1","section":"bucket.instance","name":"mnwbfc-17:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.21","timestamp":"2021-07-26T15:40:54.715356836Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_YIg4ILQxrRsVv3nMNdny4tQ","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314054.717021_289.1","section":"bucket","name":"mnwbfc-17","timestamp":"2021-07-26T15:40:54.717021427Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__QIpMgZvzHLJTVFmBVFQCgR","ver":1},"status":{"status":"write"}}},{"id":"1_1627314054.723102_290.1","section":"bucket","name":"mnwbfc-17","timestamp":"2021-07-26T15:40:54.723102331Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__QIpMgZvzHLJTVFmBVFQCgR","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314054.741286_291.1","section":"bucket.instance","name":"mnwbfc-18:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.22","timestamp":"2021-07-26T15:40:54.741286987Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ozmkqe0CJyNendJPXEfQeXu","ver":1},"status":{"status":"write"}}},{"id":"1_1627314054.746088_292.1","section":"bucket.instance","name":"mnwbfc-18:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.22","timestamp":"2021-07-26T15:40:54.746088741Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ozmkqe0CJyNendJPXEfQeXu","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314054.747794_293.1","section":"bucket","name":"mnwbfc-18","timestamp":"2021-07-26T15:40:54.747794720Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_WgR4cc8ZLwyzUZT9Tg63s8x","ver":1},"status":{"status":"write"}}},{"id":"1_1627314054.752068_294.1","section":"bucket","name":"mnwbfc-18","timestamp":"2021-07-26T15:40:54.752068499Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_WgR4cc8ZLwyzUZT9Tg63s8x","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314054.773515_295.1","section":"bucket.instance","name":"mnwbfc-17:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.21","timestamp":"2021-07-26T15:40:54.773515741Z","data":{"read_version":{"tag":"_YIg4ILQxrRsVv3nMNdny4tQ","ver":1},"write_version":{"tag":"_YIg4ILQxrRsVv3nMNdny4tQ","ver":2},"status":{"status":"write"}}},{"id":"1_1627314054.780513_296.1","section":"bucket.instance","name":"mnwbfc-17:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.21","timestamp":"2021-07-26T15:40:54.780513950Z","data":{"read_version":{"tag":"_YIg4ILQxrRsVv3nMNdny4tQ","ver":1},"write_version":{"tag":"_YIg4ILQxrRsVv3nMNdny4tQ","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314054.785747_297.1","section":"bucket.instance","name":"mnwbfc-17:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.21","timestamp":"2021-07-26T15:40:54.785747545Z","data":{"read_version":{"tag":"_YIg4ILQxrRsVv3nMNdny4tQ","ver":2},"write_version":{"tag":"_YIg4ILQxrRsVv3nMNdny4tQ","ver":3},"status":{"status":"write"}}},{"id":"1_1627314054.792321_298.1","section":"bucket.instance","name":"mnwbfc-17:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.21","timestamp":"2021-07-26T15:40:54.792321434Z","data":{"read_version":{"tag":"_YIg4ILQxrRsVv3nMNdny4tQ","ver":2},"write_version":{"tag":"_YIg4ILQxrRsVv3nMNdny4tQ","ver":3},"status":{"status":"complete"}}},{"id":"1_1627314054.797209_299.1","section":"bucket.instance","name":"mnwbfc-18:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.22","timestamp":"2021-07-26T15:40:54.797209284Z","data":{"read_version":{"tag":"_ozmkqe0CJyNendJPXEfQeXu","ver":1},"write_version":{"tag":"_ozmkqe0CJyNendJPXEfQeXu","ver":2},"status":{"status":"write"}}},{"id":"1_1627314054.803261_300.1","section":"bucket.instance","name":"mnwbfc-18:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.22","timestamp":"2021-07-26T15:40:54.803261663Z","data":{"read_version":{"tag":"_ozmkqe0CJyNendJPXEfQeXu","ver":1},"write_version":{"tag":"_ozmkqe0CJyNendJPXEfQeXu","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314054.811994_301.1","section":"bucket.instance","name":"mnwbfc-18:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.22","timestamp":"2021-07-26T15:40:54.811994610Z","data":{"read_version":{"tag":"_ozmkqe0CJyNendJPXEfQeXu","ver":2},"write_version":{"tag":"_ozmkqe0CJyNendJPXEfQeXu","ver":3},"status":{"status":"write"}}},{"id":"1_1627314054.819047_302.1","section":"bucket.instance","name":"mnwbfc-18:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.22","timestamp":"2021-07-26T15:40:54.819047817Z","data":{"read_version":{"tag":"_ozmkqe0CJyNendJPXEfQeXu","ver":2},"write_version":{"tag":"_ozmkqe0CJyNendJPXEfQeXu","ver":3},"status":{"status":"complete"}}},{"id":"1_1627314058.949135_308.1","section":"bucket.instance","name":"mnwbfc-19:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.23","timestamp":"2021-07-26T15:40:58.949135138Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_rcXPAQVLVMF-cmQ8_y-MN0k","ver":1},"status":{"status":"write"}}},{"id":"1_1627314058.955170_327.1","section":"bucket.instance","name":"mnwbfc-19:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.23","timestamp":"2021-07-26T15:40:58.955170325Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_rcXPAQVLVMF-cmQ8_y-MN0k","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314058.956787_328.1","section":"bucket","name":"mnwbfc-19","timestamp":"2021-07-26T15:40:58.956787845Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__DFFd1MtSnPGDZ3GNAzHGJM","ver":1},"status":{"status":"write"}}},{"id":"1_1627314058.962363_329.1","section":"bucket","name":"mnwbfc-19","timestamp":"2021-07-26T15:40:58.962363271Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__DFFd1MtSnPGDZ3GNAzHGJM","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314058.980941_330.1","section":"bucket.instance","name":"mnwbfc-20:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.24","timestamp":"2021-07-26T15:40:58.980941280Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-yae4WZQjdtaCjItAiFi7zp","ver":1},"status":{"status":"write"}}},{"id":"1_1627314058.985809_331.1","section":"bucket.instance","name":"mnwbfc-20:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.24","timestamp":"2021-07-26T15:40:58.985809375Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-yae4WZQjdtaCjItAiFi7zp","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314058.987340_332.1","section":"bucket","name":"mnwbfc-20","timestamp":"2021-07-26T15:40:58.987340187Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_NmH_9H8dl_CrjictonyIhRD","ver":1},"status":{"status":"write"}}},{"id":"1_1627314058.991686_333.1","section":"bucket","name":"mnwbfc-20","timestamp":"2021-07-26T15:40:58.991686445Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_NmH_9H8dl_CrjictonyIhRD","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314059.015017_334.1","section":"bucket.instance","name":"mnwbfc-19:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.23","timestamp":"2021-07-26T15:40:59.015017661Z","data":{"read_version":{"tag":"_rcXPAQVLVMF-cmQ8_y-MN0k","ver":1},"write_version":{"tag":"_rcXPAQVLVMF-cmQ8_y-MN0k","ver":2},"status":{"status":"write"}}},{"id":"1_1627314059.021979_335.1","section":"bucket.instance","name":"mnwbfc-19:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.23","timestamp":"2021-07-26T15:40:59.021979499Z","data":{"read_version":{"tag":"_rcXPAQVLVMF-cmQ8_y-MN0k","ver":1},"write_version":{"tag":"_rcXPAQVLVMF-cmQ8_y-MN0k","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314059.075238_336.1","section":"bucket.instance","name":"mnwbfc-20:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.24","timestamp":"2021-07-26T15:40:59.075238779Z","data":{"read_version":{"tag":"_-yae4WZQjdtaCjItAiFi7zp","ver":1},"write_version":{"tag":"_-yae4WZQjdtaCjItAiFi7zp","ver":2},"status":{"status":"write"}}},{"id":"1_1627314059.083442_337.1","section":"bucket.instance","name":"mnwbfc-20:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.24","timestamp":"2021-07-26T15:40:59.083442752Z","data":{"read_version":{"tag":"_-yae4WZQjdtaCjItAiFi7zp","ver":1},"write_version":{"tag":"_-yae4WZQjdtaCjItAiFi7zp","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314059.148024_338.1","section":"bucket.instance","name":"mnwbfc-21:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.25","timestamp":"2021-07-26T15:40:59.148024909Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6xkblhZeP9FA_jNHDgi_5dy","ver":1},"status":{"status":"write"}}},{"id":"1_1627314059.153231_339.1","section":"bucket.instance","name":"mnwbfc-21:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.25","timestamp":"2021-07-26T15:40:59.153231914Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6xkblhZeP9FA_jNHDgi_5dy","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314059.154737_340.1","section":"bucket","name":"mnwbfc-21","timestamp":"2021-07-26T15:40:59.154737798Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Gj1vA7kObViohB2sUdPU1LB","ver":1},"status":{"status":"write"}}},{"id":"1_1627314059.158606_341.1","section":"bucket","name":"mnwbfc-21","timestamp":"2021-07-26T15:40:59.158606297Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Gj1vA7kObViohB2sUdPU1LB","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314059.173073_342.1","section":"bucket.instance","name":"mnwbfc-22:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.26","timestamp":"2021-07-26T15:40:59.173073571Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_DXGn7NzE9GSP0TojEQ74s0k","ver":1},"status":{"status":"write"}}},{"id":"1_1627314059.177792_343.1","section":"bucket.instance","name":"mnwbfc-22:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.26","timestamp":"2021-07-26T15:40:59.177792835Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_DXGn7NzE9GSP0TojEQ74s0k","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314059.179466_344.1","section":"bucket","name":"mnwbfc-22","timestamp":"2021-07-26T15:40:59.179466612Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_wfllzexIz5ROT2GoD7jy2eD","ver":1},"status":{"status":"write"}}},{"id":"1_1627314059.183635_345.1","section":"bucket","name":"mnwbfc-22","timestamp":"2021-07-26T15:40:59.183635659Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_wfllzexIz5ROT2GoD7jy2eD","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314059.207389_346.1","section":"bucket.instance","name":"mnwbfc-21:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.25","timestamp":"2021-07-26T15:40:59.207389098Z","data":{"read_version":{"tag":"_6xkblhZeP9FA_jNHDgi_5dy","ver":1},"write_version":{"tag":"_6xkblhZeP9FA_jNHDgi_5dy","ver":2},"status":{"status":"write"}}},{"id":"1_1627314059.214762_347.1","section":"bucket.instance","name":"mnwbfc-21:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.25","timestamp":"2021-07-26T15:40:59.214762551Z","data":{"read_version":{"tag":"_6xkblhZeP9FA_jNHDgi_5dy","ver":1},"write_version":{"tag":"_6xkblhZeP9FA_jNHDgi_5dy","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314059.272723_348.1","section":"bucket.instance","name":"mnwbfc-22:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.26","timestamp":"2021-07-26T15:40:59.272723798Z","data":{"read_version":{"tag":"_DXGn7NzE9GSP0TojEQ74s0k","ver":1},"write_version":{"tag":"_DXGn7NzE9GSP0TojEQ74s0k","ver":2},"status":{"status":"write"}}},{"id":"1_1627314059.279909_349.1","section":"bucket.instance","name":"mnwbfc-22:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.26","timestamp":"2021-07-26T15:40:59.279909671Z","data":{"read_version":{"tag":"_DXGn7NzE9GSP0TojEQ74s0k","ver":1},"write_version":{"tag":"_DXGn7NzE9GSP0TojEQ74s0k","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314059.354172_350.1","section":"bucket.instance","name":"mnwbfc-23:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.27","timestamp":"2021-07-26T15:40:59.354172208Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_bZMqhIeJnEUE_xDBABY0bVo","ver":1},"status":{"status":"write"}}},{"id":"1_1627314059.358603_351.1","section":"bucket.instance","name":"mnwbfc-23:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.27","timestamp":"2021-07-26T15:40:59.358603457Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_bZMqhIeJnEUE_xDBABY0bVo","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314059.360145_352.1","section":"bucket","name":"mnwbfc-23","timestamp":"2021-07-26T15:40:59.360145390Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_RMfQcmnDnyvkAZyciK4yBB3","ver":1},"status":{"status":"write"}}},{"id":"1_1627314059.363773_353.1","section":"bucket","name":"mnwbfc-23","timestamp":"2021-07-26T15:40:59.363773275Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_RMfQcmnDnyvkAZyciK4yBB3","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314059.377553_354.1","section":"bucket.instance","name":"mnwbfc-24:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.28","timestamp":"2021-07-26T15:40:59.377553606Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_b74if3ScsyEfIYxYKssFPz1","ver":1},"status":{"status":"write"}}},{"id":"1_1627314059.382521_355.1","section":"bucket.instance","name":"mnwbfc-24:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.28","timestamp":"2021-07-26T15:40:59.382521173Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_b74if3ScsyEfIYxYKssFPz1","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314059.384421_356.1","section":"bucket","name":"mnwbfc-24","timestamp":"2021-07-26T15:40:59.384421815Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Q1-67v81oMWPt7aGYH0QI-c","ver":1},"status":{"status":"write"}}},{"id":"1_1627314059.388347_357.1","section":"bucket","name":"mnwbfc-24","timestamp":"2021-07-26T15:40:59.388347737Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Q1-67v81oMWPt7aGYH0QI-c","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314059.411770_358.1","section":"bucket.instance","name":"mnwbfc-23:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.27","timestamp":"2021-07-26T15:40:59.411770197Z","data":{"read_version":{"tag":"_bZMqhIeJnEUE_xDBABY0bVo","ver":1},"write_version":{"tag":"_bZMqhIeJnEUE_xDBABY0bVo","ver":2},"status":{"status":"write"}}},{"id":"1_1627314059.418092_359.1","section":"bucket.instance","name":"mnwbfc-23:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.27","timestamp":"2021-07-26T15:40:59.418092187Z","data":{"read_version":{"tag":"_bZMqhIeJnEUE_xDBABY0bVo","ver":1},"write_version":{"tag":"_bZMqhIeJnEUE_xDBABY0bVo","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314060.473693_360.1","section":"bucket.instance","name":"mnwbfc-24:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.28","timestamp":"2021-07-26T15:41:00.473693003Z","data":{"read_version":{"tag":"_b74if3ScsyEfIYxYKssFPz1","ver":1},"write_version":{"tag":"_b74if3ScsyEfIYxYKssFPz1","ver":2},"status":{"status":"write"}}},{"id":"1_1627314060.479595_361.1","section":"bucket.instance","name":"mnwbfc-24:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.28","timestamp":"2021-07-26T15:41:00.479595456Z","data":{"read_version":{"tag":"_b74if3ScsyEfIYxYKssFPz1","ver":1},"write_version":{"tag":"_b74if3ScsyEfIYxYKssFPz1","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314060.546898_362.1","section":"bucket.instance","name":"mnwbfc-25:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.29","timestamp":"2021-07-26T15:41:00.546898149Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_WFvjXFNVu5XDsWgBY7eEpjJ","ver":1},"status":{"status":"write"}}},{"id":"1_1627314060.552438_363.1","section":"bucket.instance","name":"mnwbfc-25:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.29","timestamp":"2021-07-26T15:41:00.552438681Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_WFvjXFNVu5XDsWgBY7eEpjJ","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314060.554188_364.1","section":"bucket","name":"mnwbfc-25","timestamp":"2021-07-26T15:41:00.554188987Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_TNl0vaUoaZtPgORfA1yoq9r","ver":1},"status":{"status":"write"}}},{"id":"1_1627314060.558136_365.1","section":"bucket","name":"mnwbfc-25","timestamp":"2021-07-26T15:41:00.558136794Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_TNl0vaUoaZtPgORfA1yoq9r","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314060.581432_366.1","section":"bucket.instance","name":"mnwbfc-26:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.30","timestamp":"2021-07-26T15:41:00.581432141Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_vzLxO-aPDULb5aYaW3gv3QK","ver":1},"status":{"status":"write"}}},{"id":"1_1627314060.586485_367.1","section":"bucket.instance","name":"mnwbfc-26:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.30","timestamp":"2021-07-26T15:41:00.586485438Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_vzLxO-aPDULb5aYaW3gv3QK","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314060.588007_368.1","section":"bucket","name":"mnwbfc-26","timestamp":"2021-07-26T15:41:00.588007312Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9fRc-1kZetuXYKxACwTcQJo","ver":1},"status":{"status":"write"}}},{"id":"1_1627314060.591810_369.1","section":"bucket","name":"mnwbfc-26","timestamp":"2021-07-26T15:41:00.591810628Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9fRc-1kZetuXYKxACwTcQJo","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314061.616732_370.1","section":"bucket.instance","name":"mnwbfc-27:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.31","timestamp":"2021-07-26T15:41:01.616732973Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_muqI8DN1pHPYmysZhHuoggz","ver":1},"status":{"status":"write"}}},{"id":"1_1627314061.621808_374.1","section":"bucket.instance","name":"mnwbfc-27:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.31","timestamp":"2021-07-26T15:41:01.621808860Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_muqI8DN1pHPYmysZhHuoggz","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314061.623645_375.1","section":"bucket","name":"mnwbfc-27","timestamp":"2021-07-26T15:41:01.623645348Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_eUvAEUwzcCNwUJDIm6XdQ5U","ver":1},"status":{"status":"write"}}},{"id":"1_1627314061.628278_376.1","section":"bucket","name":"mnwbfc-27","timestamp":"2021-07-26T15:41:01.628278470Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_eUvAEUwzcCNwUJDIm6XdQ5U","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314061.647368_377.1","section":"bucket.instance","name":"mnwbfc-28:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.32","timestamp":"2021-07-26T15:41:01.647368009Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Nxhx9mwT4Tey1S3o1VCNHUT","ver":1},"status":{"status":"write"}}},{"id":"1_1627314061.652109_378.1","section":"bucket.instance","name":"mnwbfc-28:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.32","timestamp":"2021-07-26T15:41:01.652109175Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Nxhx9mwT4Tey1S3o1VCNHUT","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314061.653602_379.1","section":"bucket","name":"mnwbfc-28","timestamp":"2021-07-26T15:41:01.653602848Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_3Rq3IEXf9LYUS2lVQmvsTPj","ver":1},"status":{"status":"write"}}},{"id":"1_1627314061.657210_380.1","section":"bucket","name":"mnwbfc-28","timestamp":"2021-07-26T15:41:01.657210217Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_3Rq3IEXf9LYUS2lVQmvsTPj","ver":1},"status":{"status":"complete"}}},{"id":"1_1627313984.492727_38.1","section":"bucket.instance","name":"mnwbfc-1:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.1","timestamp":"2021-07-26T15:39:44.492727669Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2ilRcecsshsxNNaPkgLCI3m","ver":1},"status":{"status":"write"}}},{"id":"1_1627313984.499402_39.1","section":"bucket.instance","name":"mnwbfc-1:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.1","timestamp":"2021-07-26T15:39:44.499402713Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2ilRcecsshsxNNaPkgLCI3m","ver":1},"status":{"status":"complete"}}},{"id":"1_1627313984.501377_40.1","section":"bucket","name":"mnwbfc-1","timestamp":"2021-07-26T15:39:44.501377383Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_jnfpVQRiScT1NBmYlTlOxVB","ver":1},"status":{"status":"write"}}},{"id":"1_1627313984.505842_41.1","section":"bucket","name":"mnwbfc-1","timestamp":"2021-07-26T15:39:44.505842743Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_jnfpVQRiScT1NBmYlTlOxVB","ver":1},"status":{"status":"complete"}}},{"id":"1_1627313984.529191_43.1","section":"bucket.instance","name":"mnwbfc-2:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.2","timestamp":"2021-07-26T15:39:44.529191622Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_IquMbUIbnzH2ctA6kgPu734","ver":1},"status":{"status":"write"}}},{"id":"1_1627313984.534271_44.1","section":"bucket.instance","name":"mnwbfc-2:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.2","timestamp":"2021-07-26T15:39:44.534271686Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_IquMbUIbnzH2ctA6kgPu734","ver":1},"status":{"status":"complete"}}},{"id":"1_1627313984.536126_45.1","section":"bucket","name":"mnwbfc-2","timestamp":"2021-07-26T15:39:44.536126844Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_1KlPscUVyh-zmo0oMGDjidM","ver":1},"status":{"status":"write"}}},{"id":"1_1627313984.541852_46.1","section":"bucket","name":"mnwbfc-2","timestamp":"2021-07-26T15:39:44.541852358Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_1KlPscUVyh-zmo0oMGDjidM","ver":1},"status":{"status":"complete"}}},{"id":"1_1627313993.734156_48.1","section":"bucket.instance","name":"mnwbfc-3:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.3","timestamp":"2021-07-26T15:39:53.734156015Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_zJml2Si2uL_UsILa0JiFGm1","ver":1},"status":{"status":"write"}}},{"id":"1_1627313993.739347_49.1","section":"bucket.instance","name":"mnwbfc-3:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.3","timestamp":"2021-07-26T15:39:53.739347543Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_zJml2Si2uL_UsILa0JiFGm1","ver":1},"status":{"status":"complete"}}},{"id":"1_1627313993.740848_50.1","section":"bucket","name":"mnwbfc-3","timestamp":"2021-07-26T15:39:53.740848469Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_E0-aaT85V6x7YrlShihVrn0","ver":1},"status":{"status":"write"}}},{"id":"1_1627313993.745663_51.1","section":"bucket","name":"mnwbfc-3","timestamp":"2021-07-26T15:39:53.745663090Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_E0-aaT85V6x7YrlShihVrn0","ver":1},"status":{"status":"complete"}}},{"id":"1_1627313993.766852_52.1","section":"bucket.instance","name":"mnwbfc-4:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.4","timestamp":"2021-07-26T15:39:53.766852268Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_PoPMG_g8Kf-sWpWrl7vzk5V","ver":1},"status":{"status":"write"}}},{"id":"1_1627313993.771992_53.1","section":"bucket.instance","name":"mnwbfc-4:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.4","timestamp":"2021-07-26T15:39:53.771992325Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_PoPMG_g8Kf-sWpWrl7vzk5V","ver":1},"status":{"status":"complete"}}},{"id":"1_1627313993.774106_54.1","section":"bucket","name":"mnwbfc-4","timestamp":"2021-07-26T15:39:53.774106344Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hkJ8rqOsuSMvNUqK4gZez04","ver":1},"status":{"status":"write"}}},{"id":"1_1627313993.780278_55.1","section":"bucket","name":"mnwbfc-4","timestamp":"2021-07-26T15:39:53.780278279Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hkJ8rqOsuSMvNUqK4gZez04","ver":1},"status":{"status":"complete"}}},{"id":"1_1627313994.580924_56.1","section":"bucket.instance","name":"mnwbfc-3:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.5","timestamp":"2021-07-26T15:39:54.580924435Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-soqY3Vbw19XCgtkBGERv4T","ver":1},"status":{"status":"write"}}},{"id":"1_1627313994.586359_57.1","section":"bucket.instance","name":"mnwbfc-3:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.5","timestamp":"2021-07-26T15:39:54.586359373Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-soqY3Vbw19XCgtkBGERv4T","ver":1},"status":{"status":"complete"}}},{"id":"1_1627313994.587962_58.1","section":"bucket","name":"mnwbfc-3","timestamp":"2021-07-26T15:39:54.587962266Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6GegmFQoO9rPS31WmtfnCbz","ver":1},"status":{"status":"write"}}},{"id":"1_1627313994.593508_59.1","section":"bucket","name":"mnwbfc-3","timestamp":"2021-07-26T15:39:54.593508120Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6GegmFQoO9rPS31WmtfnCbz","ver":1},"status":{"status":"abort"}}},{"id":"1_1627313994.627733_60.1","section":"bucket.instance","name":"mnwbfc-4:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.6","timestamp":"2021-07-26T15:39:54.627733013Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Wu5gj-17hEx3CVVrhJmYkY5","ver":1},"status":{"status":"write"}}},{"id":"1_1627313994.633668_61.1","section":"bucket.instance","name":"mnwbfc-4:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.6","timestamp":"2021-07-26T15:39:54.633668481Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Wu5gj-17hEx3CVVrhJmYkY5","ver":1},"status":{"status":"complete"}}},{"id":"1_1627313994.635362_62.1","section":"bucket","name":"mnwbfc-4","timestamp":"2021-07-26T15:39:54.635362508Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_E5iA5grWy3qA5awgEZbYndB","ver":1},"status":{"status":"write"}}},{"id":"1_1627313994.638260_63.1","section":"bucket","name":"mnwbfc-4","timestamp":"2021-07-26T15:39:54.638260613Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_E5iA5grWy3qA5awgEZbYndB","ver":1},"status":{"status":"abort"}}},{"id":"1_1627313994.669674_64.1","section":"bucket.instance","name":"mnwbfc-3:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.7","timestamp":"2021-07-26T15:39:54.669674240Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_T6G9jeWILPwLhmT-IWxg6Sy","ver":1},"status":{"status":"write"}}},{"id":"1_1627313994.677486_65.1","section":"bucket.instance","name":"mnwbfc-3:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.7","timestamp":"2021-07-26T15:39:54.677486939Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_T6G9jeWILPwLhmT-IWxg6Sy","ver":1},"status":{"status":"complete"}}},{"id":"1_1627313994.679129_66.1","section":"bucket","name":"mnwbfc-3","timestamp":"2021-07-26T15:39:54.679129216Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_1GvSeX4WBqTb87NZUI17-S3","ver":1},"status":{"status":"write"}}},{"id":"1_1627313994.684295_67.1","section":"bucket","name":"mnwbfc-3","timestamp":"2021-07-26T15:39:54.684295644Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_1GvSeX4WBqTb87NZUI17-S3","ver":1},"status":{"status":"abort"}}},{"id":"1_1627313994.731706_68.1","section":"bucket.instance","name":"mnwbfc-4:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.8","timestamp":"2021-07-26T15:39:54.731706537Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_aRWQp8c175MBR8VK8xBTNpJ","ver":1},"status":{"status":"write"}}},{"id":"1_1627313994.736433_69.1","section":"bucket.instance","name":"mnwbfc-4:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.8","timestamp":"2021-07-26T15:39:54.736433015Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_aRWQp8c175MBR8VK8xBTNpJ","ver":1},"status":{"status":"complete"}}},{"id":"1_1627313994.738102_70.1","section":"bucket","name":"mnwbfc-4","timestamp":"2021-07-26T15:39:54.738102656Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_anL21ZoU6gc_Prcv7SC1Evs","ver":1},"status":{"status":"write"}}},{"id":"1_1627313994.742358_71.1","section":"bucket","name":"mnwbfc-4","timestamp":"2021-07-26T15:39:54.742358498Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_anL21ZoU6gc_Prcv7SC1Evs","ver":1},"status":{"status":"abort"}}},{"id":"1_1627313995.548854_72.1","section":"bucket.instance","name":"mnwbfc-5:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.9","timestamp":"2021-07-26T15:39:55.548854641Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hWNHb8mt23isTpnkAef-qrf","ver":1},"status":{"status":"write"}}},{"id":"1_1627313995.555062_73.1","section":"bucket.instance","name":"mnwbfc-5:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.9","timestamp":"2021-07-26T15:39:55.555062744Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hWNHb8mt23isTpnkAef-qrf","ver":1},"status":{"status":"complete"}}},{"id":"1_1627313995.557585_74.1","section":"bucket","name":"mnwbfc-5","timestamp":"2021-07-26T15:39:55.557585350Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Vdm38KxNBgJYejwtYav0CYE","ver":1},"status":{"status":"write"}}},{"id":"1_1627313995.563247_75.1","section":"bucket","name":"mnwbfc-5","timestamp":"2021-07-26T15:39:55.563247065Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Vdm38KxNBgJYejwtYav0CYE","ver":1},"status":{"status":"complete"}}},{"id":"1_1627313995.582995_76.1","section":"bucket.instance","name":"mnwbfc-6:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.10","timestamp":"2021-07-26T15:39:55.582995960Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_5xOQRZJPvL1-uIccbISka6S","ver":1},"status":{"status":"write"}}},{"id":"1_1627313995.588805_77.1","section":"bucket.instance","name":"mnwbfc-6:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.10","timestamp":"2021-07-26T15:39:55.588805089Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_5xOQRZJPvL1-uIccbISka6S","ver":1},"status":{"status":"complete"}}},{"id":"1_1627313995.590526_78.1","section":"bucket","name":"mnwbfc-6","timestamp":"2021-07-26T15:39:55.590526426Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Ldhca8J2vigEg3tVrNrb7hT","ver":1},"status":{"status":"write"}}},{"id":"1_1627313995.595921_79.1","section":"bucket","name":"mnwbfc-6","timestamp":"2021-07-26T15:39:55.595921804Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Ldhca8J2vigEg3tVrNrb7hT","ver":1},"status":{"status":"complete"}}},{"id":"1_1627313996.373146_80.1","section":"bucket","name":"mnwbfc-5","timestamp":"2021-07-26T15:39:56.373146182Z","data":{"read_version":{"tag":"_Vdm38KxNBgJYejwtYav0CYE","ver":1},"write_version":{"tag":"_Vdm38KxNBgJYejwtYav0CYE","ver":2},"status":{"status":"remove"}}},{"id":"1_1627313996.378356_81.1","section":"bucket","name":"mnwbfc-5","timestamp":"2021-07-26T15:39:56.378356599Z","data":{"read_version":{"tag":"_Vdm38KxNBgJYejwtYav0CYE","ver":1},"write_version":{"tag":"_Vdm38KxNBgJYejwtYav0CYE","ver":2},"status":{"status":"complete"}}},{"id":"1_1627313996.422081_82.1","section":"bucket","name":"mnwbfc-6","timestamp":"2021-07-26T15:39:56.422081856Z","data":{"read_version":{"tag":"_Ldhca8J2vigEg3tVrNrb7hT","ver":1},"write_version":{"tag":"_Ldhca8J2vigEg3tVrNrb7hT","ver":2},"status":{"status":"remove"}}},{"id":"1_1627313996.427744_83.1","section":"bucket","name":"mnwbfc-6","timestamp":"2021-07-26T15:39:56.427744671Z","data":{"read_version":{"tag":"_Ldhca8J2vigEg3tVrNrb7hT","ver":1},"write_version":{"tag":"_Ldhca8J2vigEg3tVrNrb7hT","ver":2},"status":{"status":"complete"}}},{"id":"1_1627313997.172583_84.1","section":"bucket.instance","name":"mnwbfc-7:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.11","timestamp":"2021-07-26T15:39:57.172583236Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_5Gmt2T1VdYhJtUl3VbnJTK0","ver":1},"status":{"status":"write"}}},{"id":"1_1627313997.177182_85.1","section":"bucket.instance","name":"mnwbfc-7:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.11","timestamp":"2021-07-26T15:39:57.177182954Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_5Gmt2T1VdYhJtUl3VbnJTK0","ver":1},"status":{"status":"complete"}}},{"id":"1_1627313997.178639_86.1","section":"bucket","name":"mnwbfc-7","timestamp":"2021-07-26T15:39:57.178639348Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_A6IlO8VBhrG83SuCJK8Iqxc","ver":1},"status":{"status":"write"}}},{"id":"1_1627313997.182320_87.1","section":"bucket","name":"mnwbfc-7","timestamp":"2021-07-26T15:39:57.182320882Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_A6IlO8VBhrG83SuCJK8Iqxc","ver":1},"status":{"status":"complete"}}},{"id":"1_1627313997.198367_88.1","section":"bucket.instance","name":"mnwbfc-8:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.12","timestamp":"2021-07-26T15:39:57.198367933Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__OrCh6iWWfHmE6JHghp5Rgi","ver":1},"status":{"status":"write"}}},{"id":"1_1627313997.204119_89.1","section":"bucket.instance","name":"mnwbfc-8:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.12","timestamp":"2021-07-26T15:39:57.204119216Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__OrCh6iWWfHmE6JHghp5Rgi","ver":1},"status":{"status":"complete"}}},{"id":"1_1627313997.206473_90.1","section":"bucket","name":"mnwbfc-8","timestamp":"2021-07-26T15:39:57.206473022Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Cs5va6GAqYPmUCZGHa4XxHB","ver":1},"status":{"status":"write"}}},{"id":"1_1627313997.211404_91.1","section":"bucket","name":"mnwbfc-8","timestamp":"2021-07-26T15:39:57.211404600Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Cs5va6GAqYPmUCZGHa4XxHB","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314002.172709_100.1","section":"bucket.instance","name":"mnwbfc-9:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.13","timestamp":"2021-07-26T15:40:02.172709370Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_FsP8YpT0d1-49sbtQ4b-rA5","ver":1},"status":{"status":"write"}}},{"id":"1_1627314002.177056_101.1","section":"bucket.instance","name":"mnwbfc-9:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.13","timestamp":"2021-07-26T15:40:02.177056949Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_FsP8YpT0d1-49sbtQ4b-rA5","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314002.178561_102.1","section":"bucket","name":"mnwbfc-9","timestamp":"2021-07-26T15:40:02.178561306Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_jaUSzYKLfI-6HOoOaBMpLnh","ver":1},"status":{"status":"write"}}},{"id":"1_1627314002.183348_103.1","section":"bucket","name":"mnwbfc-9","timestamp":"2021-07-26T15:40:02.183348090Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_jaUSzYKLfI-6HOoOaBMpLnh","ver":1},"status":{"status":"complete"}}}] 2021-07-26T15:43:13.406 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', '973db1f6-3ec7-4bde-a829-51b8cda6e0ef', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:13.407 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', '973db1f6-3ec7-4bde-a829-51b8cda6e0ef', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:13.408 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period 973db1f6-3ec7-4bde-a829-51b8cda6e0ef --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:43:13.446 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:43:13.446 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:43:13.664 INFO:teuthology.orchestra.run.smithi197.stdout:[{"id":"1_1627313858.507995_25.1","section":"user","name":"rgw-multisite-test-user","timestamp":"2021-07-26T15:37:38.507995204Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6LjJeV9FVE82AHmvNh9bR46","ver":1},"status":{"status":"write"}}},{"id":"1_1627313858.513002_27.1","section":"user","name":"rgw-multisite-test-user","timestamp":"2021-07-26T15:37:38.513002270Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6LjJeV9FVE82AHmvNh9bR46","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314002.202497_41.1","section":"bucket.instance","name":"mnwbfc-10:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.14","timestamp":"2021-07-26T15:40:02.202497340Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_jH5FXSbDBvszJXegnF39XmK","ver":1},"status":{"status":"write"}}},{"id":"1_1627314002.208118_78.1","section":"bucket.instance","name":"mnwbfc-10:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.14","timestamp":"2021-07-26T15:40:02.208118599Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_jH5FXSbDBvszJXegnF39XmK","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314002.209953_79.1","section":"bucket","name":"mnwbfc-10","timestamp":"2021-07-26T15:40:02.209953787Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_pocZF6RV4psUMhk_fZ8vA1G","ver":1},"status":{"status":"write"}}},{"id":"1_1627314002.214845_80.1","section":"bucket","name":"mnwbfc-10","timestamp":"2021-07-26T15:40:02.214845795Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_pocZF6RV4psUMhk_fZ8vA1G","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314007.101113_81.1","section":"bucket.instance","name":"mnwbfc-11:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.15","timestamp":"2021-07-26T15:40:07.101113386Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_yLcBdkk0fweVDuxSnvodLeC","ver":1},"status":{"status":"write"}}},{"id":"1_1627314007.105691_103.1","section":"bucket.instance","name":"mnwbfc-11:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.15","timestamp":"2021-07-26T15:40:07.105691675Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_yLcBdkk0fweVDuxSnvodLeC","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314007.107158_104.1","section":"bucket","name":"mnwbfc-11","timestamp":"2021-07-26T15:40:07.107158515Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_vk334tlGU48YuGrMSNVJZ-z","ver":1},"status":{"status":"write"}}},{"id":"1_1627314007.111070_105.1","section":"bucket","name":"mnwbfc-11","timestamp":"2021-07-26T15:40:07.111070992Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_vk334tlGU48YuGrMSNVJZ-z","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314007.127186_106.1","section":"bucket.instance","name":"mnwbfc-12:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.16","timestamp":"2021-07-26T15:40:07.127186559Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_e4odE9Am_PbvS7yGyBRjKkA","ver":1},"status":{"status":"write"}}},{"id":"1_1627314007.131931_107.1","section":"bucket.instance","name":"mnwbfc-12:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.16","timestamp":"2021-07-26T15:40:07.131931179Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_e4odE9Am_PbvS7yGyBRjKkA","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314007.133761_108.1","section":"bucket","name":"mnwbfc-12","timestamp":"2021-07-26T15:40:07.133761612Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_EQvmtwQRBep0Y7OZGtEfMix","ver":1},"status":{"status":"write"}}},{"id":"1_1627314007.139113_109.1","section":"bucket","name":"mnwbfc-12","timestamp":"2021-07-26T15:40:07.139113296Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_EQvmtwQRBep0Y7OZGtEfMix","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314007.164399_110.1","section":"bucket.instance","name":"mnwbfc-11:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.15","timestamp":"2021-07-26T15:40:07.164399541Z","data":{"read_version":{"tag":"_yLcBdkk0fweVDuxSnvodLeC","ver":1},"write_version":{"tag":"_yLcBdkk0fweVDuxSnvodLeC","ver":2},"status":{"status":"write"}}},{"id":"1_1627314007.171304_111.1","section":"bucket.instance","name":"mnwbfc-11:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.15","timestamp":"2021-07-26T15:40:07.171304049Z","data":{"read_version":{"tag":"_yLcBdkk0fweVDuxSnvodLeC","ver":1},"write_version":{"tag":"_yLcBdkk0fweVDuxSnvodLeC","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314007.177229_112.1","section":"bucket.instance","name":"mnwbfc-12:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.16","timestamp":"2021-07-26T15:40:07.177229849Z","data":{"read_version":{"tag":"_e4odE9Am_PbvS7yGyBRjKkA","ver":1},"write_version":{"tag":"_e4odE9Am_PbvS7yGyBRjKkA","ver":2},"status":{"status":"write"}}},{"id":"1_1627314007.183769_113.1","section":"bucket.instance","name":"mnwbfc-12:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.16","timestamp":"2021-07-26T15:40:07.183769887Z","data":{"read_version":{"tag":"_e4odE9Am_PbvS7yGyBRjKkA","ver":1},"write_version":{"tag":"_e4odE9Am_PbvS7yGyBRjKkA","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314019.513680_114.1","section":"bucket.instance","name":"mnwbfc-13:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.17","timestamp":"2021-07-26T15:40:19.513680358Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_VBFkjsQ5Ef7fuHh8lWr9ncS","ver":1},"status":{"status":"write"}}},{"id":"1_1627314019.519356_163.1","section":"bucket.instance","name":"mnwbfc-13:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.17","timestamp":"2021-07-26T15:40:19.519356702Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_VBFkjsQ5Ef7fuHh8lWr9ncS","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314019.521188_164.1","section":"bucket","name":"mnwbfc-13","timestamp":"2021-07-26T15:40:19.521188191Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_LPlYfw1E8YhiiIUwePogHvO","ver":1},"status":{"status":"write"}}},{"id":"1_1627314019.526593_165.1","section":"bucket","name":"mnwbfc-13","timestamp":"2021-07-26T15:40:19.526593055Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_LPlYfw1E8YhiiIUwePogHvO","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314019.533381_166.1","section":"bucket.instance","name":"mnwbfc-13:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.17","timestamp":"2021-07-26T15:40:19.533381506Z","data":{"read_version":{"tag":"_VBFkjsQ5Ef7fuHh8lWr9ncS","ver":1},"write_version":{"tag":"_VBFkjsQ5Ef7fuHh8lWr9ncS","ver":2},"status":{"status":"write"}}},{"id":"1_1627314019.539764_167.1","section":"bucket.instance","name":"mnwbfc-13:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.17","timestamp":"2021-07-26T15:40:19.539764629Z","data":{"read_version":{"tag":"_VBFkjsQ5Ef7fuHh8lWr9ncS","ver":1},"write_version":{"tag":"_VBFkjsQ5Ef7fuHh8lWr9ncS","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314042.503842_168.1","section":"bucket.instance","name":"mnwbfc-14:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.18","timestamp":"2021-07-26T15:40:42.503842215Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_EtxRYHr1FqzG9ewQewiD2h4","ver":1},"status":{"status":"write"}}},{"id":"1_1627314042.508569_199.1","section":"bucket.instance","name":"mnwbfc-14:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.18","timestamp":"2021-07-26T15:40:42.508569366Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_EtxRYHr1FqzG9ewQewiD2h4","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314042.510073_200.1","section":"bucket","name":"mnwbfc-14","timestamp":"2021-07-26T15:40:42.510073204Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_t-vTV2WhTSH06d8_q8RPhqT","ver":1},"status":{"status":"write"}}},{"id":"1_1627314042.513829_201.1","section":"bucket","name":"mnwbfc-14","timestamp":"2021-07-26T15:40:42.513829898Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_t-vTV2WhTSH06d8_q8RPhqT","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314044.968708_214.1","section":"bucket.instance","name":"mnwbfc-14:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.18","timestamp":"2021-07-26T15:40:44.968708542Z","data":{"read_version":{"tag":"_EtxRYHr1FqzG9ewQewiD2h4","ver":1},"write_version":{"tag":"_EtxRYHr1FqzG9ewQewiD2h4","ver":2},"status":{"status":"write"}}},{"id":"1_1627314044.975949_221.1","section":"bucket.instance","name":"mnwbfc-14:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.18","timestamp":"2021-07-26T15:40:44.975949254Z","data":{"read_version":{"tag":"_EtxRYHr1FqzG9ewQewiD2h4","ver":1},"write_version":{"tag":"_EtxRYHr1FqzG9ewQewiD2h4","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314047.717788_228.1","section":"bucket.instance","name":"mnwbfc-14:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.18","timestamp":"2021-07-26T15:40:47.717788491Z","data":{"read_version":{"tag":"_EtxRYHr1FqzG9ewQewiD2h4","ver":2},"write_version":{"tag":"_EtxRYHr1FqzG9ewQewiD2h4","ver":3},"status":{"status":"write"}}},{"id":"1_1627314047.723857_238.1","section":"bucket.instance","name":"mnwbfc-14:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.18","timestamp":"2021-07-26T15:40:47.723857922Z","data":{"read_version":{"tag":"_EtxRYHr1FqzG9ewQewiD2h4","ver":2},"write_version":{"tag":"_EtxRYHr1FqzG9ewQewiD2h4","ver":3},"status":{"status":"complete"}}},{"id":"1_1627314050.412473_248.1","section":"bucket.instance","name":"mnwbfc-15:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.19","timestamp":"2021-07-26T15:40:50.412473220Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_TOrw69_N-l7EXnS9m_Qs-Sq","ver":1},"status":{"status":"write"}}},{"id":"1_1627314050.416323_255.1","section":"bucket.instance","name":"mnwbfc-15:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.19","timestamp":"2021-07-26T15:40:50.416323128Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_TOrw69_N-l7EXnS9m_Qs-Sq","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314050.417793_256.1","section":"bucket","name":"mnwbfc-15","timestamp":"2021-07-26T15:40:50.417793587Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_qjneeS_m0Zl9-0tTONz3yFt","ver":1},"status":{"status":"write"}}},{"id":"1_1627314050.421539_257.1","section":"bucket","name":"mnwbfc-15","timestamp":"2021-07-26T15:40:50.421539967Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_qjneeS_m0Zl9-0tTONz3yFt","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314050.437822_258.1","section":"bucket.instance","name":"mnwbfc-16:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.20","timestamp":"2021-07-26T15:40:50.437822429Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_NfZn_StQ13Uw4JGOJME3UYG","ver":1},"status":{"status":"write"}}},{"id":"1_1627314050.443081_259.1","section":"bucket.instance","name":"mnwbfc-16:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.20","timestamp":"2021-07-26T15:40:50.443081316Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_NfZn_StQ13Uw4JGOJME3UYG","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314050.444947_260.1","section":"bucket","name":"mnwbfc-16","timestamp":"2021-07-26T15:40:50.444947344Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_WUM8uLjqrGSCGHYj3vNqU6w","ver":1},"status":{"status":"write"}}},{"id":"1_1627314050.449052_261.1","section":"bucket","name":"mnwbfc-16","timestamp":"2021-07-26T15:40:50.449052278Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_WUM8uLjqrGSCGHYj3vNqU6w","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314050.471159_262.1","section":"bucket.instance","name":"mnwbfc-15:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.19","timestamp":"2021-07-26T15:40:50.471159562Z","data":{"read_version":{"tag":"_TOrw69_N-l7EXnS9m_Qs-Sq","ver":1},"write_version":{"tag":"_TOrw69_N-l7EXnS9m_Qs-Sq","ver":2},"status":{"status":"write"}}},{"id":"1_1627314050.477155_263.1","section":"bucket.instance","name":"mnwbfc-15:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.19","timestamp":"2021-07-26T15:40:50.477155576Z","data":{"read_version":{"tag":"_TOrw69_N-l7EXnS9m_Qs-Sq","ver":1},"write_version":{"tag":"_TOrw69_N-l7EXnS9m_Qs-Sq","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314050.482723_264.1","section":"bucket.instance","name":"mnwbfc-16:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.20","timestamp":"2021-07-26T15:40:50.482723843Z","data":{"read_version":{"tag":"_NfZn_StQ13Uw4JGOJME3UYG","ver":1},"write_version":{"tag":"_NfZn_StQ13Uw4JGOJME3UYG","ver":2},"status":{"status":"write"}}},{"id":"1_1627314050.489390_265.1","section":"bucket.instance","name":"mnwbfc-16:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.20","timestamp":"2021-07-26T15:40:50.489390895Z","data":{"read_version":{"tag":"_NfZn_StQ13Uw4JGOJME3UYG","ver":1},"write_version":{"tag":"_NfZn_StQ13Uw4JGOJME3UYG","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314054.709441_266.1","section":"bucket.instance","name":"mnwbfc-17:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.21","timestamp":"2021-07-26T15:40:54.709441412Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_YIg4ILQxrRsVv3nMNdny4tQ","ver":1},"status":{"status":"write"}}},{"id":"1_1627314054.715356_288.1","section":"bucket.instance","name":"mnwbfc-17:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.21","timestamp":"2021-07-26T15:40:54.715356836Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_YIg4ILQxrRsVv3nMNdny4tQ","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314054.717021_289.1","section":"bucket","name":"mnwbfc-17","timestamp":"2021-07-26T15:40:54.717021427Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__QIpMgZvzHLJTVFmBVFQCgR","ver":1},"status":{"status":"write"}}},{"id":"1_1627314054.723102_290.1","section":"bucket","name":"mnwbfc-17","timestamp":"2021-07-26T15:40:54.723102331Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__QIpMgZvzHLJTVFmBVFQCgR","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314054.741286_291.1","section":"bucket.instance","name":"mnwbfc-18:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.22","timestamp":"2021-07-26T15:40:54.741286987Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ozmkqe0CJyNendJPXEfQeXu","ver":1},"status":{"status":"write"}}},{"id":"1_1627314054.746088_292.1","section":"bucket.instance","name":"mnwbfc-18:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.22","timestamp":"2021-07-26T15:40:54.746088741Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ozmkqe0CJyNendJPXEfQeXu","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314054.747794_293.1","section":"bucket","name":"mnwbfc-18","timestamp":"2021-07-26T15:40:54.747794720Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_WgR4cc8ZLwyzUZT9Tg63s8x","ver":1},"status":{"status":"write"}}},{"id":"1_1627314054.752068_294.1","section":"bucket","name":"mnwbfc-18","timestamp":"2021-07-26T15:40:54.752068499Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_WgR4cc8ZLwyzUZT9Tg63s8x","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314054.773515_295.1","section":"bucket.instance","name":"mnwbfc-17:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.21","timestamp":"2021-07-26T15:40:54.773515741Z","data":{"read_version":{"tag":"_YIg4ILQxrRsVv3nMNdny4tQ","ver":1},"write_version":{"tag":"_YIg4ILQxrRsVv3nMNdny4tQ","ver":2},"status":{"status":"write"}}},{"id":"1_1627314054.780513_296.1","section":"bucket.instance","name":"mnwbfc-17:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.21","timestamp":"2021-07-26T15:40:54.780513950Z","data":{"read_version":{"tag":"_YIg4ILQxrRsVv3nMNdny4tQ","ver":1},"write_version":{"tag":"_YIg4ILQxrRsVv3nMNdny4tQ","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314054.785747_297.1","section":"bucket.instance","name":"mnwbfc-17:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.21","timestamp":"2021-07-26T15:40:54.785747545Z","data":{"read_version":{"tag":"_YIg4ILQxrRsVv3nMNdny4tQ","ver":2},"write_version":{"tag":"_YIg4ILQxrRsVv3nMNdny4tQ","ver":3},"status":{"status":"write"}}},{"id":"1_1627314054.792321_298.1","section":"bucket.instance","name":"mnwbfc-17:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.21","timestamp":"2021-07-26T15:40:54.792321434Z","data":{"read_version":{"tag":"_YIg4ILQxrRsVv3nMNdny4tQ","ver":2},"write_version":{"tag":"_YIg4ILQxrRsVv3nMNdny4tQ","ver":3},"status":{"status":"complete"}}},{"id":"1_1627314054.797209_299.1","section":"bucket.instance","name":"mnwbfc-18:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.22","timestamp":"2021-07-26T15:40:54.797209284Z","data":{"read_version":{"tag":"_ozmkqe0CJyNendJPXEfQeXu","ver":1},"write_version":{"tag":"_ozmkqe0CJyNendJPXEfQeXu","ver":2},"status":{"status":"write"}}},{"id":"1_1627314054.803261_300.1","section":"bucket.instance","name":"mnwbfc-18:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.22","timestamp":"2021-07-26T15:40:54.803261663Z","data":{"read_version":{"tag":"_ozmkqe0CJyNendJPXEfQeXu","ver":1},"write_version":{"tag":"_ozmkqe0CJyNendJPXEfQeXu","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314054.811994_301.1","section":"bucket.instance","name":"mnwbfc-18:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.22","timestamp":"2021-07-26T15:40:54.811994610Z","data":{"read_version":{"tag":"_ozmkqe0CJyNendJPXEfQeXu","ver":2},"write_version":{"tag":"_ozmkqe0CJyNendJPXEfQeXu","ver":3},"status":{"status":"write"}}},{"id":"1_1627314054.819047_302.1","section":"bucket.instance","name":"mnwbfc-18:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.22","timestamp":"2021-07-26T15:40:54.819047817Z","data":{"read_version":{"tag":"_ozmkqe0CJyNendJPXEfQeXu","ver":2},"write_version":{"tag":"_ozmkqe0CJyNendJPXEfQeXu","ver":3},"status":{"status":"complete"}}},{"id":"1_1627314058.949135_308.1","section":"bucket.instance","name":"mnwbfc-19:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.23","timestamp":"2021-07-26T15:40:58.949135138Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_rcXPAQVLVMF-cmQ8_y-MN0k","ver":1},"status":{"status":"write"}}},{"id":"1_1627314058.955170_327.1","section":"bucket.instance","name":"mnwbfc-19:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.23","timestamp":"2021-07-26T15:40:58.955170325Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_rcXPAQVLVMF-cmQ8_y-MN0k","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314058.956787_328.1","section":"bucket","name":"mnwbfc-19","timestamp":"2021-07-26T15:40:58.956787845Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__DFFd1MtSnPGDZ3GNAzHGJM","ver":1},"status":{"status":"write"}}},{"id":"1_1627314058.962363_329.1","section":"bucket","name":"mnwbfc-19","timestamp":"2021-07-26T15:40:58.962363271Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__DFFd1MtSnPGDZ3GNAzHGJM","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314058.980941_330.1","section":"bucket.instance","name":"mnwbfc-20:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.24","timestamp":"2021-07-26T15:40:58.980941280Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-yae4WZQjdtaCjItAiFi7zp","ver":1},"status":{"status":"write"}}},{"id":"1_1627314058.985809_331.1","section":"bucket.instance","name":"mnwbfc-20:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.24","timestamp":"2021-07-26T15:40:58.985809375Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-yae4WZQjdtaCjItAiFi7zp","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314058.987340_332.1","section":"bucket","name":"mnwbfc-20","timestamp":"2021-07-26T15:40:58.987340187Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_NmH_9H8dl_CrjictonyIhRD","ver":1},"status":{"status":"write"}}},{"id":"1_1627314058.991686_333.1","section":"bucket","name":"mnwbfc-20","timestamp":"2021-07-26T15:40:58.991686445Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_NmH_9H8dl_CrjictonyIhRD","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314059.015017_334.1","section":"bucket.instance","name":"mnwbfc-19:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.23","timestamp":"2021-07-26T15:40:59.015017661Z","data":{"read_version":{"tag":"_rcXPAQVLVMF-cmQ8_y-MN0k","ver":1},"write_version":{"tag":"_rcXPAQVLVMF-cmQ8_y-MN0k","ver":2},"status":{"status":"write"}}},{"id":"1_1627314059.021979_335.1","section":"bucket.instance","name":"mnwbfc-19:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.23","timestamp":"2021-07-26T15:40:59.021979499Z","data":{"read_version":{"tag":"_rcXPAQVLVMF-cmQ8_y-MN0k","ver":1},"write_version":{"tag":"_rcXPAQVLVMF-cmQ8_y-MN0k","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314059.075238_336.1","section":"bucket.instance","name":"mnwbfc-20:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.24","timestamp":"2021-07-26T15:40:59.075238779Z","data":{"read_version":{"tag":"_-yae4WZQjdtaCjItAiFi7zp","ver":1},"write_version":{"tag":"_-yae4WZQjdtaCjItAiFi7zp","ver":2},"status":{"status":"write"}}},{"id":"1_1627314059.083442_337.1","section":"bucket.instance","name":"mnwbfc-20:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.24","timestamp":"2021-07-26T15:40:59.083442752Z","data":{"read_version":{"tag":"_-yae4WZQjdtaCjItAiFi7zp","ver":1},"write_version":{"tag":"_-yae4WZQjdtaCjItAiFi7zp","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314059.148024_338.1","section":"bucket.instance","name":"mnwbfc-21:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.25","timestamp":"2021-07-26T15:40:59.148024909Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6xkblhZeP9FA_jNHDgi_5dy","ver":1},"status":{"status":"write"}}},{"id":"1_1627314059.153231_339.1","section":"bucket.instance","name":"mnwbfc-21:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.25","timestamp":"2021-07-26T15:40:59.153231914Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6xkblhZeP9FA_jNHDgi_5dy","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314059.154737_340.1","section":"bucket","name":"mnwbfc-21","timestamp":"2021-07-26T15:40:59.154737798Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Gj1vA7kObViohB2sUdPU1LB","ver":1},"status":{"status":"write"}}},{"id":"1_1627314059.158606_341.1","section":"bucket","name":"mnwbfc-21","timestamp":"2021-07-26T15:40:59.158606297Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Gj1vA7kObViohB2sUdPU1LB","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314059.173073_342.1","section":"bucket.instance","name":"mnwbfc-22:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.26","timestamp":"2021-07-26T15:40:59.173073571Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_DXGn7NzE9GSP0TojEQ74s0k","ver":1},"status":{"status":"write"}}},{"id":"1_1627314059.177792_343.1","section":"bucket.instance","name":"mnwbfc-22:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.26","timestamp":"2021-07-26T15:40:59.177792835Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_DXGn7NzE9GSP0TojEQ74s0k","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314059.179466_344.1","section":"bucket","name":"mnwbfc-22","timestamp":"2021-07-26T15:40:59.179466612Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_wfllzexIz5ROT2GoD7jy2eD","ver":1},"status":{"status":"write"}}},{"id":"1_1627314059.183635_345.1","section":"bucket","name":"mnwbfc-22","timestamp":"2021-07-26T15:40:59.183635659Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_wfllzexIz5ROT2GoD7jy2eD","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314059.207389_346.1","section":"bucket.instance","name":"mnwbfc-21:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.25","timestamp":"2021-07-26T15:40:59.207389098Z","data":{"read_version":{"tag":"_6xkblhZeP9FA_jNHDgi_5dy","ver":1},"write_version":{"tag":"_6xkblhZeP9FA_jNHDgi_5dy","ver":2},"status":{"status":"write"}}},{"id":"1_1627314059.214762_347.1","section":"bucket.instance","name":"mnwbfc-21:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.25","timestamp":"2021-07-26T15:40:59.214762551Z","data":{"read_version":{"tag":"_6xkblhZeP9FA_jNHDgi_5dy","ver":1},"write_version":{"tag":"_6xkblhZeP9FA_jNHDgi_5dy","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314059.272723_348.1","section":"bucket.instance","name":"mnwbfc-22:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.26","timestamp":"2021-07-26T15:40:59.272723798Z","data":{"read_version":{"tag":"_DXGn7NzE9GSP0TojEQ74s0k","ver":1},"write_version":{"tag":"_DXGn7NzE9GSP0TojEQ74s0k","ver":2},"status":{"status":"write"}}},{"id":"1_1627314059.279909_349.1","section":"bucket.instance","name":"mnwbfc-22:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.26","timestamp":"2021-07-26T15:40:59.279909671Z","data":{"read_version":{"tag":"_DXGn7NzE9GSP0TojEQ74s0k","ver":1},"write_version":{"tag":"_DXGn7NzE9GSP0TojEQ74s0k","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314059.354172_350.1","section":"bucket.instance","name":"mnwbfc-23:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.27","timestamp":"2021-07-26T15:40:59.354172208Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_bZMqhIeJnEUE_xDBABY0bVo","ver":1},"status":{"status":"write"}}},{"id":"1_1627314059.358603_351.1","section":"bucket.instance","name":"mnwbfc-23:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.27","timestamp":"2021-07-26T15:40:59.358603457Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_bZMqhIeJnEUE_xDBABY0bVo","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314059.360145_352.1","section":"bucket","name":"mnwbfc-23","timestamp":"2021-07-26T15:40:59.360145390Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_RMfQcmnDnyvkAZyciK4yBB3","ver":1},"status":{"status":"write"}}},{"id":"1_1627314059.363773_353.1","section":"bucket","name":"mnwbfc-23","timestamp":"2021-07-26T15:40:59.363773275Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_RMfQcmnDnyvkAZyciK4yBB3","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314059.377553_354.1","section":"bucket.instance","name":"mnwbfc-24:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.28","timestamp":"2021-07-26T15:40:59.377553606Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_b74if3ScsyEfIYxYKssFPz1","ver":1},"status":{"status":"write"}}},{"id":"1_1627314059.382521_355.1","section":"bucket.instance","name":"mnwbfc-24:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.28","timestamp":"2021-07-26T15:40:59.382521173Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_b74if3ScsyEfIYxYKssFPz1","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314059.384421_356.1","section":"bucket","name":"mnwbfc-24","timestamp":"2021-07-26T15:40:59.384421815Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Q1-67v81oMWPt7aGYH0QI-c","ver":1},"status":{"status":"write"}}},{"id":"1_1627314059.388347_357.1","section":"bucket","name":"mnwbfc-24","timestamp":"2021-07-26T15:40:59.388347737Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Q1-67v81oMWPt7aGYH0QI-c","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314059.411770_358.1","section":"bucket.instance","name":"mnwbfc-23:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.27","timestamp":"2021-07-26T15:40:59.411770197Z","data":{"read_version":{"tag":"_bZMqhIeJnEUE_xDBABY0bVo","ver":1},"write_version":{"tag":"_bZMqhIeJnEUE_xDBABY0bVo","ver":2},"status":{"status":"write"}}},{"id":"1_1627314059.418092_359.1","section":"bucket.instance","name":"mnwbfc-23:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.27","timestamp":"2021-07-26T15:40:59.418092187Z","data":{"read_version":{"tag":"_bZMqhIeJnEUE_xDBABY0bVo","ver":1},"write_version":{"tag":"_bZMqhIeJnEUE_xDBABY0bVo","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314060.473693_360.1","section":"bucket.instance","name":"mnwbfc-24:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.28","timestamp":"2021-07-26T15:41:00.473693003Z","data":{"read_version":{"tag":"_b74if3ScsyEfIYxYKssFPz1","ver":1},"write_version":{"tag":"_b74if3ScsyEfIYxYKssFPz1","ver":2},"status":{"status":"write"}}},{"id":"1_1627314060.479595_361.1","section":"bucket.instance","name":"mnwbfc-24:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.28","timestamp":"2021-07-26T15:41:00.479595456Z","data":{"read_version":{"tag":"_b74if3ScsyEfIYxYKssFPz1","ver":1},"write_version":{"tag":"_b74if3ScsyEfIYxYKssFPz1","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314060.546898_362.1","section":"bucket.instance","name":"mnwbfc-25:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.29","timestamp":"2021-07-26T15:41:00.546898149Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_WFvjXFNVu5XDsWgBY7eEpjJ","ver":1},"status":{"status":"write"}}},{"id":"1_1627314060.552438_363.1","section":"bucket.instance","name":"mnwbfc-25:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.29","timestamp":"2021-07-26T15:41:00.552438681Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_WFvjXFNVu5XDsWgBY7eEpjJ","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314060.554188_364.1","section":"bucket","name":"mnwbfc-25","timestamp":"2021-07-26T15:41:00.554188987Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_TNl0vaUoaZtPgORfA1yoq9r","ver":1},"status":{"status":"write"}}},{"id":"1_1627314060.558136_365.1","section":"bucket","name":"mnwbfc-25","timestamp":"2021-07-26T15:41:00.558136794Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_TNl0vaUoaZtPgORfA1yoq9r","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314060.581432_366.1","section":"bucket.instance","name":"mnwbfc-26:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.30","timestamp":"2021-07-26T15:41:00.581432141Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_vzLxO-aPDULb5aYaW3gv3QK","ver":1},"status":{"status":"write"}}},{"id":"1_1627314060.586485_367.1","section":"bucket.instance","name":"mnwbfc-26:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.30","timestamp":"2021-07-26T15:41:00.586485438Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_vzLxO-aPDULb5aYaW3gv3QK","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314060.588007_368.1","section":"bucket","name":"mnwbfc-26","timestamp":"2021-07-26T15:41:00.588007312Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9fRc-1kZetuXYKxACwTcQJo","ver":1},"status":{"status":"write"}}},{"id":"1_1627314060.591810_369.1","section":"bucket","name":"mnwbfc-26","timestamp":"2021-07-26T15:41:00.591810628Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9fRc-1kZetuXYKxACwTcQJo","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314061.616732_370.1","section":"bucket.instance","name":"mnwbfc-27:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.31","timestamp":"2021-07-26T15:41:01.616732973Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_muqI8DN1pHPYmysZhHuoggz","ver":1},"status":{"status":"write"}}},{"id":"1_1627314061.621808_374.1","section":"bucket.instance","name":"mnwbfc-27:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.31","timestamp":"2021-07-26T15:41:01.621808860Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_muqI8DN1pHPYmysZhHuoggz","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314061.623645_375.1","section":"bucket","name":"mnwbfc-27","timestamp":"2021-07-26T15:41:01.623645348Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_eUvAEUwzcCNwUJDIm6XdQ5U","ver":1},"status":{"status":"write"}}},{"id":"1_1627314061.628278_376.1","section":"bucket","name":"mnwbfc-27","timestamp":"2021-07-26T15:41:01.628278470Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_eUvAEUwzcCNwUJDIm6XdQ5U","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314061.647368_377.1","section":"bucket.instance","name":"mnwbfc-28:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.32","timestamp":"2021-07-26T15:41:01.647368009Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Nxhx9mwT4Tey1S3o1VCNHUT","ver":1},"status":{"status":"write"}}},{"id":"1_1627314061.652109_378.1","section":"bucket.instance","name":"mnwbfc-28:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.32","timestamp":"2021-07-26T15:41:01.652109175Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Nxhx9mwT4Tey1S3o1VCNHUT","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314061.653602_379.1","section":"bucket","name":"mnwbfc-28","timestamp":"2021-07-26T15:41:01.653602848Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_3Rq3IEXf9LYUS2lVQmvsTPj","ver":1},"status":{"status":"write"}}},{"id":"1_1627314061.657210_380.1","section":"bucket","name":"mnwbfc-28","timestamp":"2021-07-26T15:41:01.657210217Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_3Rq3IEXf9LYUS2lVQmvsTPj","ver":1},"status":{"status":"complete"}}},{"id":"1_1627313984.492727_38.1","section":"bucket.instance","name":"mnwbfc-1:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.1","timestamp":"2021-07-26T15:39:44.492727669Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2ilRcecsshsxNNaPkgLCI3m","ver":1},"status":{"status":"write"}}},{"id":"1_1627313984.499402_39.1","section":"bucket.instance","name":"mnwbfc-1:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.1","timestamp":"2021-07-26T15:39:44.499402713Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2ilRcecsshsxNNaPkgLCI3m","ver":1},"status":{"status":"complete"}}},{"id":"1_1627313984.501377_40.1","section":"bucket","name":"mnwbfc-1","timestamp":"2021-07-26T15:39:44.501377383Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_jnfpVQRiScT1NBmYlTlOxVB","ver":1},"status":{"status":"write"}}},{"id":"1_1627313984.505842_41.1","section":"bucket","name":"mnwbfc-1","timestamp":"2021-07-26T15:39:44.505842743Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_jnfpVQRiScT1NBmYlTlOxVB","ver":1},"status":{"status":"complete"}}},{"id":"1_1627313984.529191_43.1","section":"bucket.instance","name":"mnwbfc-2:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.2","timestamp":"2021-07-26T15:39:44.529191622Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_IquMbUIbnzH2ctA6kgPu734","ver":1},"status":{"status":"write"}}},{"id":"1_1627313984.534271_44.1","section":"bucket.instance","name":"mnwbfc-2:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.2","timestamp":"2021-07-26T15:39:44.534271686Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_IquMbUIbnzH2ctA6kgPu734","ver":1},"status":{"status":"complete"}}},{"id":"1_1627313984.536126_45.1","section":"bucket","name":"mnwbfc-2","timestamp":"2021-07-26T15:39:44.536126844Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_1KlPscUVyh-zmo0oMGDjidM","ver":1},"status":{"status":"write"}}},{"id":"1_1627313984.541852_46.1","section":"bucket","name":"mnwbfc-2","timestamp":"2021-07-26T15:39:44.541852358Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_1KlPscUVyh-zmo0oMGDjidM","ver":1},"status":{"status":"complete"}}},{"id":"1_1627313993.734156_48.1","section":"bucket.instance","name":"mnwbfc-3:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.3","timestamp":"2021-07-26T15:39:53.734156015Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_zJml2Si2uL_UsILa0JiFGm1","ver":1},"status":{"status":"write"}}},{"id":"1_1627313993.739347_49.1","section":"bucket.instance","name":"mnwbfc-3:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.3","timestamp":"2021-07-26T15:39:53.739347543Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_zJml2Si2uL_UsILa0JiFGm1","ver":1},"status":{"status":"complete"}}},{"id":"1_1627313993.740848_50.1","section":"bucket","name":"mnwbfc-3","timestamp":"2021-07-26T15:39:53.740848469Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_E0-aaT85V6x7YrlShihVrn0","ver":1},"status":{"status":"write"}}},{"id":"1_1627313993.745663_51.1","section":"bucket","name":"mnwbfc-3","timestamp":"2021-07-26T15:39:53.745663090Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_E0-aaT85V6x7YrlShihVrn0","ver":1},"status":{"status":"complete"}}},{"id":"1_1627313993.766852_52.1","section":"bucket.instance","name":"mnwbfc-4:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.4","timestamp":"2021-07-26T15:39:53.766852268Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_PoPMG_g8Kf-sWpWrl7vzk5V","ver":1},"status":{"status":"write"}}},{"id":"1_1627313993.771992_53.1","section":"bucket.instance","name":"mnwbfc-4:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.4","timestamp":"2021-07-26T15:39:53.771992325Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_PoPMG_g8Kf-sWpWrl7vzk5V","ver":1},"status":{"status":"complete"}}},{"id":"1_1627313993.774106_54.1","section":"bucket","name":"mnwbfc-4","timestamp":"2021-07-26T15:39:53.774106344Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hkJ8rqOsuSMvNUqK4gZez04","ver":1},"status":{"status":"write"}}},{"id":"1_1627313993.780278_55.1","section":"bucket","name":"mnwbfc-4","timestamp":"2021-07-26T15:39:53.780278279Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hkJ8rqOsuSMvNUqK4gZez04","ver":1},"status":{"status":"complete"}}},{"id":"1_1627313994.580924_56.1","section":"bucket.instance","name":"mnwbfc-3:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.5","timestamp":"2021-07-26T15:39:54.580924435Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-soqY3Vbw19XCgtkBGERv4T","ver":1},"status":{"status":"write"}}},{"id":"1_1627313994.586359_57.1","section":"bucket.instance","name":"mnwbfc-3:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.5","timestamp":"2021-07-26T15:39:54.586359373Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-soqY3Vbw19XCgtkBGERv4T","ver":1},"status":{"status":"complete"}}},{"id":"1_1627313994.587962_58.1","section":"bucket","name":"mnwbfc-3","timestamp":"2021-07-26T15:39:54.587962266Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6GegmFQoO9rPS31WmtfnCbz","ver":1},"status":{"status":"write"}}},{"id":"1_1627313994.593508_59.1","section":"bucket","name":"mnwbfc-3","timestamp":"2021-07-26T15:39:54.593508120Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6GegmFQoO9rPS31WmtfnCbz","ver":1},"status":{"status":"abort"}}},{"id":"1_1627313994.627733_60.1","section":"bucket.instance","name":"mnwbfc-4:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.6","timestamp":"2021-07-26T15:39:54.627733013Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Wu5gj-17hEx3CVVrhJmYkY5","ver":1},"status":{"status":"write"}}},{"id":"1_1627313994.633668_61.1","section":"bucket.instance","name":"mnwbfc-4:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.6","timestamp":"2021-07-26T15:39:54.633668481Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Wu5gj-17hEx3CVVrhJmYkY5","ver":1},"status":{"status":"complete"}}},{"id":"1_1627313994.635362_62.1","section":"bucket","name":"mnwbfc-4","timestamp":"2021-07-26T15:39:54.635362508Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_E5iA5grWy3qA5awgEZbYndB","ver":1},"status":{"status":"write"}}},{"id":"1_1627313994.638260_63.1","section":"bucket","name":"mnwbfc-4","timestamp":"2021-07-26T15:39:54.638260613Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_E5iA5grWy3qA5awgEZbYndB","ver":1},"status":{"status":"abort"}}},{"id":"1_1627313994.669674_64.1","section":"bucket.instance","name":"mnwbfc-3:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.7","timestamp":"2021-07-26T15:39:54.669674240Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_T6G9jeWILPwLhmT-IWxg6Sy","ver":1},"status":{"status":"write"}}},{"id":"1_1627313994.677486_65.1","section":"bucket.instance","name":"mnwbfc-3:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.7","timestamp":"2021-07-26T15:39:54.677486939Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_T6G9jeWILPwLhmT-IWxg6Sy","ver":1},"status":{"status":"complete"}}},{"id":"1_1627313994.679129_66.1","section":"bucket","name":"mnwbfc-3","timestamp":"2021-07-26T15:39:54.679129216Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_1GvSeX4WBqTb87NZUI17-S3","ver":1},"status":{"status":"write"}}},{"id":"1_1627313994.684295_67.1","section":"bucket","name":"mnwbfc-3","timestamp":"2021-07-26T15:39:54.684295644Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_1GvSeX4WBqTb87NZUI17-S3","ver":1},"status":{"status":"abort"}}},{"id":"1_1627313994.731706_68.1","section":"bucket.instance","name":"mnwbfc-4:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.8","timestamp":"2021-07-26T15:39:54.731706537Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_aRWQp8c175MBR8VK8xBTNpJ","ver":1},"status":{"status":"write"}}},{"id":"1_1627313994.736433_69.1","section":"bucket.instance","name":"mnwbfc-4:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.8","timestamp":"2021-07-26T15:39:54.736433015Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_aRWQp8c175MBR8VK8xBTNpJ","ver":1},"status":{"status":"complete"}}},{"id":"1_1627313994.738102_70.1","section":"bucket","name":"mnwbfc-4","timestamp":"2021-07-26T15:39:54.738102656Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_anL21ZoU6gc_Prcv7SC1Evs","ver":1},"status":{"status":"write"}}},{"id":"1_1627313994.742358_71.1","section":"bucket","name":"mnwbfc-4","timestamp":"2021-07-26T15:39:54.742358498Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_anL21ZoU6gc_Prcv7SC1Evs","ver":1},"status":{"status":"abort"}}},{"id":"1_1627313995.548854_72.1","section":"bucket.instance","name":"mnwbfc-5:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.9","timestamp":"2021-07-26T15:39:55.548854641Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hWNHb8mt23isTpnkAef-qrf","ver":1},"status":{"status":"write"}}},{"id":"1_1627313995.555062_73.1","section":"bucket.instance","name":"mnwbfc-5:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.9","timestamp":"2021-07-26T15:39:55.555062744Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hWNHb8mt23isTpnkAef-qrf","ver":1},"status":{"status":"complete"}}},{"id":"1_1627313995.557585_74.1","section":"bucket","name":"mnwbfc-5","timestamp":"2021-07-26T15:39:55.557585350Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Vdm38KxNBgJYejwtYav0CYE","ver":1},"status":{"status":"write"}}},{"id":"1_1627313995.563247_75.1","section":"bucket","name":"mnwbfc-5","timestamp":"2021-07-26T15:39:55.563247065Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Vdm38KxNBgJYejwtYav0CYE","ver":1},"status":{"status":"complete"}}},{"id":"1_1627313995.582995_76.1","section":"bucket.instance","name":"mnwbfc-6:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.10","timestamp":"2021-07-26T15:39:55.582995960Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_5xOQRZJPvL1-uIccbISka6S","ver":1},"status":{"status":"write"}}},{"id":"1_1627313995.588805_77.1","section":"bucket.instance","name":"mnwbfc-6:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.10","timestamp":"2021-07-26T15:39:55.588805089Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_5xOQRZJPvL1-uIccbISka6S","ver":1},"status":{"status":"complete"}}},{"id":"1_1627313995.590526_78.1","section":"bucket","name":"mnwbfc-6","timestamp":"2021-07-26T15:39:55.590526426Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Ldhca8J2vigEg3tVrNrb7hT","ver":1},"status":{"status":"write"}}},{"id":"1_1627313995.595921_79.1","section":"bucket","name":"mnwbfc-6","timestamp":"2021-07-26T15:39:55.595921804Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Ldhca8J2vigEg3tVrNrb7hT","ver":1},"status":{"status":"complete"}}},{"id":"1_1627313996.373146_80.1","section":"bucket","name":"mnwbfc-5","timestamp":"2021-07-26T15:39:56.373146182Z","data":{"read_version":{"tag":"_Vdm38KxNBgJYejwtYav0CYE","ver":1},"write_version":{"tag":"_Vdm38KxNBgJYejwtYav0CYE","ver":2},"status":{"status":"remove"}}},{"id":"1_1627313996.378356_81.1","section":"bucket","name":"mnwbfc-5","timestamp":"2021-07-26T15:39:56.378356599Z","data":{"read_version":{"tag":"_Vdm38KxNBgJYejwtYav0CYE","ver":1},"write_version":{"tag":"_Vdm38KxNBgJYejwtYav0CYE","ver":2},"status":{"status":"complete"}}},{"id":"1_1627313996.422081_82.1","section":"bucket","name":"mnwbfc-6","timestamp":"2021-07-26T15:39:56.422081856Z","data":{"read_version":{"tag":"_Ldhca8J2vigEg3tVrNrb7hT","ver":1},"write_version":{"tag":"_Ldhca8J2vigEg3tVrNrb7hT","ver":2},"status":{"status":"remove"}}},{"id":"1_1627313996.427744_83.1","section":"bucket","name":"mnwbfc-6","timestamp":"2021-07-26T15:39:56.427744671Z","data":{"read_version":{"tag":"_Ldhca8J2vigEg3tVrNrb7hT","ver":1},"write_version":{"tag":"_Ldhca8J2vigEg3tVrNrb7hT","ver":2},"status":{"status":"complete"}}},{"id":"1_1627313997.172583_84.1","section":"bucket.instance","name":"mnwbfc-7:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.11","timestamp":"2021-07-26T15:39:57.172583236Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_5Gmt2T1VdYhJtUl3VbnJTK0","ver":1},"status":{"status":"write"}}},{"id":"1_1627313997.177182_85.1","section":"bucket.instance","name":"mnwbfc-7:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.11","timestamp":"2021-07-26T15:39:57.177182954Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_5Gmt2T1VdYhJtUl3VbnJTK0","ver":1},"status":{"status":"complete"}}},{"id":"1_1627313997.178639_86.1","section":"bucket","name":"mnwbfc-7","timestamp":"2021-07-26T15:39:57.178639348Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_A6IlO8VBhrG83SuCJK8Iqxc","ver":1},"status":{"status":"write"}}},{"id":"1_1627313997.182320_87.1","section":"bucket","name":"mnwbfc-7","timestamp":"2021-07-26T15:39:57.182320882Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_A6IlO8VBhrG83SuCJK8Iqxc","ver":1},"status":{"status":"complete"}}},{"id":"1_1627313997.198367_88.1","section":"bucket.instance","name":"mnwbfc-8:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.12","timestamp":"2021-07-26T15:39:57.198367933Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__OrCh6iWWfHmE6JHghp5Rgi","ver":1},"status":{"status":"write"}}},{"id":"1_1627313997.204119_89.1","section":"bucket.instance","name":"mnwbfc-8:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.12","timestamp":"2021-07-26T15:39:57.204119216Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__OrCh6iWWfHmE6JHghp5Rgi","ver":1},"status":{"status":"complete"}}},{"id":"1_1627313997.206473_90.1","section":"bucket","name":"mnwbfc-8","timestamp":"2021-07-26T15:39:57.206473022Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Cs5va6GAqYPmUCZGHa4XxHB","ver":1},"status":{"status":"write"}}},{"id":"1_1627313997.211404_91.1","section":"bucket","name":"mnwbfc-8","timestamp":"2021-07-26T15:39:57.211404600Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Cs5va6GAqYPmUCZGHa4XxHB","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314002.172709_100.1","section":"bucket.instance","name":"mnwbfc-9:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.13","timestamp":"2021-07-26T15:40:02.172709370Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_FsP8YpT0d1-49sbtQ4b-rA5","ver":1},"status":{"status":"write"}}},{"id":"1_1627314002.177056_101.1","section":"bucket.instance","name":"mnwbfc-9:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.13","timestamp":"2021-07-26T15:40:02.177056949Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_FsP8YpT0d1-49sbtQ4b-rA5","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314002.178561_102.1","section":"bucket","name":"mnwbfc-9","timestamp":"2021-07-26T15:40:02.178561306Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_jaUSzYKLfI-6HOoOaBMpLnh","ver":1},"status":{"status":"write"}}},{"id":"1_1627314002.183348_103.1","section":"bucket","name":"mnwbfc-9","timestamp":"2021-07-26T15:40:02.183348090Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_jaUSzYKLfI-6HOoOaBMpLnh","ver":1},"status":{"status":"complete"}}}] 2021-07-26T15:43:13.666 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', '973db1f6-3ec7-4bde-a829-51b8cda6e0ef', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:13.667 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', '973db1f6-3ec7-4bde-a829-51b8cda6e0ef', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:13.667 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period 973db1f6-3ec7-4bde-a829-51b8cda6e0ef --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:43:13.703 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:43:13.703 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:43:13.886 INFO:teuthology.orchestra.run.smithi197.stdout:[{"id":"1_1627313858.507995_25.1","section":"user","name":"rgw-multisite-test-user","timestamp":"2021-07-26T15:37:38.507995204Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6LjJeV9FVE82AHmvNh9bR46","ver":1},"status":{"status":"write"}}},{"id":"1_1627313858.513002_27.1","section":"user","name":"rgw-multisite-test-user","timestamp":"2021-07-26T15:37:38.513002270Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6LjJeV9FVE82AHmvNh9bR46","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314002.202497_41.1","section":"bucket.instance","name":"mnwbfc-10:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.14","timestamp":"2021-07-26T15:40:02.202497340Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_jH5FXSbDBvszJXegnF39XmK","ver":1},"status":{"status":"write"}}},{"id":"1_1627314002.208118_78.1","section":"bucket.instance","name":"mnwbfc-10:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.14","timestamp":"2021-07-26T15:40:02.208118599Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_jH5FXSbDBvszJXegnF39XmK","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314002.209953_79.1","section":"bucket","name":"mnwbfc-10","timestamp":"2021-07-26T15:40:02.209953787Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_pocZF6RV4psUMhk_fZ8vA1G","ver":1},"status":{"status":"write"}}},{"id":"1_1627314002.214845_80.1","section":"bucket","name":"mnwbfc-10","timestamp":"2021-07-26T15:40:02.214845795Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_pocZF6RV4psUMhk_fZ8vA1G","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314007.101113_81.1","section":"bucket.instance","name":"mnwbfc-11:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.15","timestamp":"2021-07-26T15:40:07.101113386Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_yLcBdkk0fweVDuxSnvodLeC","ver":1},"status":{"status":"write"}}},{"id":"1_1627314007.105691_103.1","section":"bucket.instance","name":"mnwbfc-11:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.15","timestamp":"2021-07-26T15:40:07.105691675Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_yLcBdkk0fweVDuxSnvodLeC","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314007.107158_104.1","section":"bucket","name":"mnwbfc-11","timestamp":"2021-07-26T15:40:07.107158515Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_vk334tlGU48YuGrMSNVJZ-z","ver":1},"status":{"status":"write"}}},{"id":"1_1627314007.111070_105.1","section":"bucket","name":"mnwbfc-11","timestamp":"2021-07-26T15:40:07.111070992Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_vk334tlGU48YuGrMSNVJZ-z","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314007.127186_106.1","section":"bucket.instance","name":"mnwbfc-12:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.16","timestamp":"2021-07-26T15:40:07.127186559Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_e4odE9Am_PbvS7yGyBRjKkA","ver":1},"status":{"status":"write"}}},{"id":"1_1627314007.131931_107.1","section":"bucket.instance","name":"mnwbfc-12:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.16","timestamp":"2021-07-26T15:40:07.131931179Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_e4odE9Am_PbvS7yGyBRjKkA","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314007.133761_108.1","section":"bucket","name":"mnwbfc-12","timestamp":"2021-07-26T15:40:07.133761612Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_EQvmtwQRBep0Y7OZGtEfMix","ver":1},"status":{"status":"write"}}},{"id":"1_1627314007.139113_109.1","section":"bucket","name":"mnwbfc-12","timestamp":"2021-07-26T15:40:07.139113296Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_EQvmtwQRBep0Y7OZGtEfMix","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314007.164399_110.1","section":"bucket.instance","name":"mnwbfc-11:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.15","timestamp":"2021-07-26T15:40:07.164399541Z","data":{"read_version":{"tag":"_yLcBdkk0fweVDuxSnvodLeC","ver":1},"write_version":{"tag":"_yLcBdkk0fweVDuxSnvodLeC","ver":2},"status":{"status":"write"}}},{"id":"1_1627314007.171304_111.1","section":"bucket.instance","name":"mnwbfc-11:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.15","timestamp":"2021-07-26T15:40:07.171304049Z","data":{"read_version":{"tag":"_yLcBdkk0fweVDuxSnvodLeC","ver":1},"write_version":{"tag":"_yLcBdkk0fweVDuxSnvodLeC","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314007.177229_112.1","section":"bucket.instance","name":"mnwbfc-12:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.16","timestamp":"2021-07-26T15:40:07.177229849Z","data":{"read_version":{"tag":"_e4odE9Am_PbvS7yGyBRjKkA","ver":1},"write_version":{"tag":"_e4odE9Am_PbvS7yGyBRjKkA","ver":2},"status":{"status":"write"}}},{"id":"1_1627314007.183769_113.1","section":"bucket.instance","name":"mnwbfc-12:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.16","timestamp":"2021-07-26T15:40:07.183769887Z","data":{"read_version":{"tag":"_e4odE9Am_PbvS7yGyBRjKkA","ver":1},"write_version":{"tag":"_e4odE9Am_PbvS7yGyBRjKkA","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314019.513680_114.1","section":"bucket.instance","name":"mnwbfc-13:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.17","timestamp":"2021-07-26T15:40:19.513680358Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_VBFkjsQ5Ef7fuHh8lWr9ncS","ver":1},"status":{"status":"write"}}},{"id":"1_1627314019.519356_163.1","section":"bucket.instance","name":"mnwbfc-13:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.17","timestamp":"2021-07-26T15:40:19.519356702Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_VBFkjsQ5Ef7fuHh8lWr9ncS","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314019.521188_164.1","section":"bucket","name":"mnwbfc-13","timestamp":"2021-07-26T15:40:19.521188191Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_LPlYfw1E8YhiiIUwePogHvO","ver":1},"status":{"status":"write"}}},{"id":"1_1627314019.526593_165.1","section":"bucket","name":"mnwbfc-13","timestamp":"2021-07-26T15:40:19.526593055Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_LPlYfw1E8YhiiIUwePogHvO","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314019.533381_166.1","section":"bucket.instance","name":"mnwbfc-13:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.17","timestamp":"2021-07-26T15:40:19.533381506Z","data":{"read_version":{"tag":"_VBFkjsQ5Ef7fuHh8lWr9ncS","ver":1},"write_version":{"tag":"_VBFkjsQ5Ef7fuHh8lWr9ncS","ver":2},"status":{"status":"write"}}},{"id":"1_1627314019.539764_167.1","section":"bucket.instance","name":"mnwbfc-13:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.17","timestamp":"2021-07-26T15:40:19.539764629Z","data":{"read_version":{"tag":"_VBFkjsQ5Ef7fuHh8lWr9ncS","ver":1},"write_version":{"tag":"_VBFkjsQ5Ef7fuHh8lWr9ncS","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314042.503842_168.1","section":"bucket.instance","name":"mnwbfc-14:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.18","timestamp":"2021-07-26T15:40:42.503842215Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_EtxRYHr1FqzG9ewQewiD2h4","ver":1},"status":{"status":"write"}}},{"id":"1_1627314042.508569_199.1","section":"bucket.instance","name":"mnwbfc-14:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.18","timestamp":"2021-07-26T15:40:42.508569366Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_EtxRYHr1FqzG9ewQewiD2h4","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314042.510073_200.1","section":"bucket","name":"mnwbfc-14","timestamp":"2021-07-26T15:40:42.510073204Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_t-vTV2WhTSH06d8_q8RPhqT","ver":1},"status":{"status":"write"}}},{"id":"1_1627314042.513829_201.1","section":"bucket","name":"mnwbfc-14","timestamp":"2021-07-26T15:40:42.513829898Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_t-vTV2WhTSH06d8_q8RPhqT","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314044.968708_214.1","section":"bucket.instance","name":"mnwbfc-14:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.18","timestamp":"2021-07-26T15:40:44.968708542Z","data":{"read_version":{"tag":"_EtxRYHr1FqzG9ewQewiD2h4","ver":1},"write_version":{"tag":"_EtxRYHr1FqzG9ewQewiD2h4","ver":2},"status":{"status":"write"}}},{"id":"1_1627314044.975949_221.1","section":"bucket.instance","name":"mnwbfc-14:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.18","timestamp":"2021-07-26T15:40:44.975949254Z","data":{"read_version":{"tag":"_EtxRYHr1FqzG9ewQewiD2h4","ver":1},"write_version":{"tag":"_EtxRYHr1FqzG9ewQewiD2h4","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314047.717788_228.1","section":"bucket.instance","name":"mnwbfc-14:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.18","timestamp":"2021-07-26T15:40:47.717788491Z","data":{"read_version":{"tag":"_EtxRYHr1FqzG9ewQewiD2h4","ver":2},"write_version":{"tag":"_EtxRYHr1FqzG9ewQewiD2h4","ver":3},"status":{"status":"write"}}},{"id":"1_1627314047.723857_238.1","section":"bucket.instance","name":"mnwbfc-14:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.18","timestamp":"2021-07-26T15:40:47.723857922Z","data":{"read_version":{"tag":"_EtxRYHr1FqzG9ewQewiD2h4","ver":2},"write_version":{"tag":"_EtxRYHr1FqzG9ewQewiD2h4","ver":3},"status":{"status":"complete"}}},{"id":"1_1627314050.412473_248.1","section":"bucket.instance","name":"mnwbfc-15:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.19","timestamp":"2021-07-26T15:40:50.412473220Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_TOrw69_N-l7EXnS9m_Qs-Sq","ver":1},"status":{"status":"write"}}},{"id":"1_1627314050.416323_255.1","section":"bucket.instance","name":"mnwbfc-15:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.19","timestamp":"2021-07-26T15:40:50.416323128Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_TOrw69_N-l7EXnS9m_Qs-Sq","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314050.417793_256.1","section":"bucket","name":"mnwbfc-15","timestamp":"2021-07-26T15:40:50.417793587Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_qjneeS_m0Zl9-0tTONz3yFt","ver":1},"status":{"status":"write"}}},{"id":"1_1627314050.421539_257.1","section":"bucket","name":"mnwbfc-15","timestamp":"2021-07-26T15:40:50.421539967Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_qjneeS_m0Zl9-0tTONz3yFt","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314050.437822_258.1","section":"bucket.instance","name":"mnwbfc-16:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.20","timestamp":"2021-07-26T15:40:50.437822429Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_NfZn_StQ13Uw4JGOJME3UYG","ver":1},"status":{"status":"write"}}},{"id":"1_1627314050.443081_259.1","section":"bucket.instance","name":"mnwbfc-16:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.20","timestamp":"2021-07-26T15:40:50.443081316Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_NfZn_StQ13Uw4JGOJME3UYG","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314050.444947_260.1","section":"bucket","name":"mnwbfc-16","timestamp":"2021-07-26T15:40:50.444947344Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_WUM8uLjqrGSCGHYj3vNqU6w","ver":1},"status":{"status":"write"}}},{"id":"1_1627314050.449052_261.1","section":"bucket","name":"mnwbfc-16","timestamp":"2021-07-26T15:40:50.449052278Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_WUM8uLjqrGSCGHYj3vNqU6w","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314050.471159_262.1","section":"bucket.instance","name":"mnwbfc-15:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.19","timestamp":"2021-07-26T15:40:50.471159562Z","data":{"read_version":{"tag":"_TOrw69_N-l7EXnS9m_Qs-Sq","ver":1},"write_version":{"tag":"_TOrw69_N-l7EXnS9m_Qs-Sq","ver":2},"status":{"status":"write"}}},{"id":"1_1627314050.477155_263.1","section":"bucket.instance","name":"mnwbfc-15:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.19","timestamp":"2021-07-26T15:40:50.477155576Z","data":{"read_version":{"tag":"_TOrw69_N-l7EXnS9m_Qs-Sq","ver":1},"write_version":{"tag":"_TOrw69_N-l7EXnS9m_Qs-Sq","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314050.482723_264.1","section":"bucket.instance","name":"mnwbfc-16:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.20","timestamp":"2021-07-26T15:40:50.482723843Z","data":{"read_version":{"tag":"_NfZn_StQ13Uw4JGOJME3UYG","ver":1},"write_version":{"tag":"_NfZn_StQ13Uw4JGOJME3UYG","ver":2},"status":{"status":"write"}}},{"id":"1_1627314050.489390_265.1","section":"bucket.instance","name":"mnwbfc-16:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.20","timestamp":"2021-07-26T15:40:50.489390895Z","data":{"read_version":{"tag":"_NfZn_StQ13Uw4JGOJME3UYG","ver":1},"write_version":{"tag":"_NfZn_StQ13Uw4JGOJME3UYG","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314054.709441_266.1","section":"bucket.instance","name":"mnwbfc-17:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.21","timestamp":"2021-07-26T15:40:54.709441412Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_YIg4ILQxrRsVv3nMNdny4tQ","ver":1},"status":{"status":"write"}}},{"id":"1_1627314054.715356_288.1","section":"bucket.instance","name":"mnwbfc-17:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.21","timestamp":"2021-07-26T15:40:54.715356836Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_YIg4ILQxrRsVv3nMNdny4tQ","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314054.717021_289.1","section":"bucket","name":"mnwbfc-17","timestamp":"2021-07-26T15:40:54.717021427Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__QIpMgZvzHLJTVFmBVFQCgR","ver":1},"status":{"status":"write"}}},{"id":"1_1627314054.723102_290.1","section":"bucket","name":"mnwbfc-17","timestamp":"2021-07-26T15:40:54.723102331Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__QIpMgZvzHLJTVFmBVFQCgR","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314054.741286_291.1","section":"bucket.instance","name":"mnwbfc-18:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.22","timestamp":"2021-07-26T15:40:54.741286987Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ozmkqe0CJyNendJPXEfQeXu","ver":1},"status":{"status":"write"}}},{"id":"1_1627314054.746088_292.1","section":"bucket.instance","name":"mnwbfc-18:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.22","timestamp":"2021-07-26T15:40:54.746088741Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ozmkqe0CJyNendJPXEfQeXu","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314054.747794_293.1","section":"bucket","name":"mnwbfc-18","timestamp":"2021-07-26T15:40:54.747794720Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_WgR4cc8ZLwyzUZT9Tg63s8x","ver":1},"status":{"status":"write"}}},{"id":"1_1627314054.752068_294.1","section":"bucket","name":"mnwbfc-18","timestamp":"2021-07-26T15:40:54.752068499Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_WgR4cc8ZLwyzUZT9Tg63s8x","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314054.773515_295.1","section":"bucket.instance","name":"mnwbfc-17:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.21","timestamp":"2021-07-26T15:40:54.773515741Z","data":{"read_version":{"tag":"_YIg4ILQxrRsVv3nMNdny4tQ","ver":1},"write_version":{"tag":"_YIg4ILQxrRsVv3nMNdny4tQ","ver":2},"status":{"status":"write"}}},{"id":"1_1627314054.780513_296.1","section":"bucket.instance","name":"mnwbfc-17:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.21","timestamp":"2021-07-26T15:40:54.780513950Z","data":{"read_version":{"tag":"_YIg4ILQxrRsVv3nMNdny4tQ","ver":1},"write_version":{"tag":"_YIg4ILQxrRsVv3nMNdny4tQ","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314054.785747_297.1","section":"bucket.instance","name":"mnwbfc-17:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.21","timestamp":"2021-07-26T15:40:54.785747545Z","data":{"read_version":{"tag":"_YIg4ILQxrRsVv3nMNdny4tQ","ver":2},"write_version":{"tag":"_YIg4ILQxrRsVv3nMNdny4tQ","ver":3},"status":{"status":"write"}}},{"id":"1_1627314054.792321_298.1","section":"bucket.instance","name":"mnwbfc-17:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.21","timestamp":"2021-07-26T15:40:54.792321434Z","data":{"read_version":{"tag":"_YIg4ILQxrRsVv3nMNdny4tQ","ver":2},"write_version":{"tag":"_YIg4ILQxrRsVv3nMNdny4tQ","ver":3},"status":{"status":"complete"}}},{"id":"1_1627314054.797209_299.1","section":"bucket.instance","name":"mnwbfc-18:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.22","timestamp":"2021-07-26T15:40:54.797209284Z","data":{"read_version":{"tag":"_ozmkqe0CJyNendJPXEfQeXu","ver":1},"write_version":{"tag":"_ozmkqe0CJyNendJPXEfQeXu","ver":2},"status":{"status":"write"}}},{"id":"1_1627314054.803261_300.1","section":"bucket.instance","name":"mnwbfc-18:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.22","timestamp":"2021-07-26T15:40:54.803261663Z","data":{"read_version":{"tag":"_ozmkqe0CJyNendJPXEfQeXu","ver":1},"write_version":{"tag":"_ozmkqe0CJyNendJPXEfQeXu","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314054.811994_301.1","section":"bucket.instance","name":"mnwbfc-18:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.22","timestamp":"2021-07-26T15:40:54.811994610Z","data":{"read_version":{"tag":"_ozmkqe0CJyNendJPXEfQeXu","ver":2},"write_version":{"tag":"_ozmkqe0CJyNendJPXEfQeXu","ver":3},"status":{"status":"write"}}},{"id":"1_1627314054.819047_302.1","section":"bucket.instance","name":"mnwbfc-18:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.22","timestamp":"2021-07-26T15:40:54.819047817Z","data":{"read_version":{"tag":"_ozmkqe0CJyNendJPXEfQeXu","ver":2},"write_version":{"tag":"_ozmkqe0CJyNendJPXEfQeXu","ver":3},"status":{"status":"complete"}}},{"id":"1_1627314058.949135_308.1","section":"bucket.instance","name":"mnwbfc-19:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.23","timestamp":"2021-07-26T15:40:58.949135138Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_rcXPAQVLVMF-cmQ8_y-MN0k","ver":1},"status":{"status":"write"}}},{"id":"1_1627314058.955170_327.1","section":"bucket.instance","name":"mnwbfc-19:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.23","timestamp":"2021-07-26T15:40:58.955170325Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_rcXPAQVLVMF-cmQ8_y-MN0k","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314058.956787_328.1","section":"bucket","name":"mnwbfc-19","timestamp":"2021-07-26T15:40:58.956787845Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__DFFd1MtSnPGDZ3GNAzHGJM","ver":1},"status":{"status":"write"}}},{"id":"1_1627314058.962363_329.1","section":"bucket","name":"mnwbfc-19","timestamp":"2021-07-26T15:40:58.962363271Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__DFFd1MtSnPGDZ3GNAzHGJM","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314058.980941_330.1","section":"bucket.instance","name":"mnwbfc-20:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.24","timestamp":"2021-07-26T15:40:58.980941280Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-yae4WZQjdtaCjItAiFi7zp","ver":1},"status":{"status":"write"}}},{"id":"1_1627314058.985809_331.1","section":"bucket.instance","name":"mnwbfc-20:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.24","timestamp":"2021-07-26T15:40:58.985809375Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-yae4WZQjdtaCjItAiFi7zp","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314058.987340_332.1","section":"bucket","name":"mnwbfc-20","timestamp":"2021-07-26T15:40:58.987340187Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_NmH_9H8dl_CrjictonyIhRD","ver":1},"status":{"status":"write"}}},{"id":"1_1627314058.991686_333.1","section":"bucket","name":"mnwbfc-20","timestamp":"2021-07-26T15:40:58.991686445Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_NmH_9H8dl_CrjictonyIhRD","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314059.015017_334.1","section":"bucket.instance","name":"mnwbfc-19:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.23","timestamp":"2021-07-26T15:40:59.015017661Z","data":{"read_version":{"tag":"_rcXPAQVLVMF-cmQ8_y-MN0k","ver":1},"write_version":{"tag":"_rcXPAQVLVMF-cmQ8_y-MN0k","ver":2},"status":{"status":"write"}}},{"id":"1_1627314059.021979_335.1","section":"bucket.instance","name":"mnwbfc-19:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.23","timestamp":"2021-07-26T15:40:59.021979499Z","data":{"read_version":{"tag":"_rcXPAQVLVMF-cmQ8_y-MN0k","ver":1},"write_version":{"tag":"_rcXPAQVLVMF-cmQ8_y-MN0k","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314059.075238_336.1","section":"bucket.instance","name":"mnwbfc-20:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.24","timestamp":"2021-07-26T15:40:59.075238779Z","data":{"read_version":{"tag":"_-yae4WZQjdtaCjItAiFi7zp","ver":1},"write_version":{"tag":"_-yae4WZQjdtaCjItAiFi7zp","ver":2},"status":{"status":"write"}}},{"id":"1_1627314059.083442_337.1","section":"bucket.instance","name":"mnwbfc-20:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.24","timestamp":"2021-07-26T15:40:59.083442752Z","data":{"read_version":{"tag":"_-yae4WZQjdtaCjItAiFi7zp","ver":1},"write_version":{"tag":"_-yae4WZQjdtaCjItAiFi7zp","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314059.148024_338.1","section":"bucket.instance","name":"mnwbfc-21:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.25","timestamp":"2021-07-26T15:40:59.148024909Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6xkblhZeP9FA_jNHDgi_5dy","ver":1},"status":{"status":"write"}}},{"id":"1_1627314059.153231_339.1","section":"bucket.instance","name":"mnwbfc-21:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.25","timestamp":"2021-07-26T15:40:59.153231914Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6xkblhZeP9FA_jNHDgi_5dy","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314059.154737_340.1","section":"bucket","name":"mnwbfc-21","timestamp":"2021-07-26T15:40:59.154737798Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Gj1vA7kObViohB2sUdPU1LB","ver":1},"status":{"status":"write"}}},{"id":"1_1627314059.158606_341.1","section":"bucket","name":"mnwbfc-21","timestamp":"2021-07-26T15:40:59.158606297Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Gj1vA7kObViohB2sUdPU1LB","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314059.173073_342.1","section":"bucket.instance","name":"mnwbfc-22:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.26","timestamp":"2021-07-26T15:40:59.173073571Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_DXGn7NzE9GSP0TojEQ74s0k","ver":1},"status":{"status":"write"}}},{"id":"1_1627314059.177792_343.1","section":"bucket.instance","name":"mnwbfc-22:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.26","timestamp":"2021-07-26T15:40:59.177792835Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_DXGn7NzE9GSP0TojEQ74s0k","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314059.179466_344.1","section":"bucket","name":"mnwbfc-22","timestamp":"2021-07-26T15:40:59.179466612Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_wfllzexIz5ROT2GoD7jy2eD","ver":1},"status":{"status":"write"}}},{"id":"1_1627314059.183635_345.1","section":"bucket","name":"mnwbfc-22","timestamp":"2021-07-26T15:40:59.183635659Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_wfllzexIz5ROT2GoD7jy2eD","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314059.207389_346.1","section":"bucket.instance","name":"mnwbfc-21:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.25","timestamp":"2021-07-26T15:40:59.207389098Z","data":{"read_version":{"tag":"_6xkblhZeP9FA_jNHDgi_5dy","ver":1},"write_version":{"tag":"_6xkblhZeP9FA_jNHDgi_5dy","ver":2},"status":{"status":"write"}}},{"id":"1_1627314059.214762_347.1","section":"bucket.instance","name":"mnwbfc-21:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.25","timestamp":"2021-07-26T15:40:59.214762551Z","data":{"read_version":{"tag":"_6xkblhZeP9FA_jNHDgi_5dy","ver":1},"write_version":{"tag":"_6xkblhZeP9FA_jNHDgi_5dy","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314059.272723_348.1","section":"bucket.instance","name":"mnwbfc-22:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.26","timestamp":"2021-07-26T15:40:59.272723798Z","data":{"read_version":{"tag":"_DXGn7NzE9GSP0TojEQ74s0k","ver":1},"write_version":{"tag":"_DXGn7NzE9GSP0TojEQ74s0k","ver":2},"status":{"status":"write"}}},{"id":"1_1627314059.279909_349.1","section":"bucket.instance","name":"mnwbfc-22:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.26","timestamp":"2021-07-26T15:40:59.279909671Z","data":{"read_version":{"tag":"_DXGn7NzE9GSP0TojEQ74s0k","ver":1},"write_version":{"tag":"_DXGn7NzE9GSP0TojEQ74s0k","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314059.354172_350.1","section":"bucket.instance","name":"mnwbfc-23:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.27","timestamp":"2021-07-26T15:40:59.354172208Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_bZMqhIeJnEUE_xDBABY0bVo","ver":1},"status":{"status":"write"}}},{"id":"1_1627314059.358603_351.1","section":"bucket.instance","name":"mnwbfc-23:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.27","timestamp":"2021-07-26T15:40:59.358603457Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_bZMqhIeJnEUE_xDBABY0bVo","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314059.360145_352.1","section":"bucket","name":"mnwbfc-23","timestamp":"2021-07-26T15:40:59.360145390Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_RMfQcmnDnyvkAZyciK4yBB3","ver":1},"status":{"status":"write"}}},{"id":"1_1627314059.363773_353.1","section":"bucket","name":"mnwbfc-23","timestamp":"2021-07-26T15:40:59.363773275Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_RMfQcmnDnyvkAZyciK4yBB3","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314059.377553_354.1","section":"bucket.instance","name":"mnwbfc-24:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.28","timestamp":"2021-07-26T15:40:59.377553606Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_b74if3ScsyEfIYxYKssFPz1","ver":1},"status":{"status":"write"}}},{"id":"1_1627314059.382521_355.1","section":"bucket.instance","name":"mnwbfc-24:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.28","timestamp":"2021-07-26T15:40:59.382521173Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_b74if3ScsyEfIYxYKssFPz1","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314059.384421_356.1","section":"bucket","name":"mnwbfc-24","timestamp":"2021-07-26T15:40:59.384421815Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Q1-67v81oMWPt7aGYH0QI-c","ver":1},"status":{"status":"write"}}},{"id":"1_1627314059.388347_357.1","section":"bucket","name":"mnwbfc-24","timestamp":"2021-07-26T15:40:59.388347737Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Q1-67v81oMWPt7aGYH0QI-c","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314059.411770_358.1","section":"bucket.instance","name":"mnwbfc-23:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.27","timestamp":"2021-07-26T15:40:59.411770197Z","data":{"read_version":{"tag":"_bZMqhIeJnEUE_xDBABY0bVo","ver":1},"write_version":{"tag":"_bZMqhIeJnEUE_xDBABY0bVo","ver":2},"status":{"status":"write"}}},{"id":"1_1627314059.418092_359.1","section":"bucket.instance","name":"mnwbfc-23:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.27","timestamp":"2021-07-26T15:40:59.418092187Z","data":{"read_version":{"tag":"_bZMqhIeJnEUE_xDBABY0bVo","ver":1},"write_version":{"tag":"_bZMqhIeJnEUE_xDBABY0bVo","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314060.473693_360.1","section":"bucket.instance","name":"mnwbfc-24:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.28","timestamp":"2021-07-26T15:41:00.473693003Z","data":{"read_version":{"tag":"_b74if3ScsyEfIYxYKssFPz1","ver":1},"write_version":{"tag":"_b74if3ScsyEfIYxYKssFPz1","ver":2},"status":{"status":"write"}}},{"id":"1_1627314060.479595_361.1","section":"bucket.instance","name":"mnwbfc-24:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.28","timestamp":"2021-07-26T15:41:00.479595456Z","data":{"read_version":{"tag":"_b74if3ScsyEfIYxYKssFPz1","ver":1},"write_version":{"tag":"_b74if3ScsyEfIYxYKssFPz1","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314060.546898_362.1","section":"bucket.instance","name":"mnwbfc-25:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.29","timestamp":"2021-07-26T15:41:00.546898149Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_WFvjXFNVu5XDsWgBY7eEpjJ","ver":1},"status":{"status":"write"}}},{"id":"1_1627314060.552438_363.1","section":"bucket.instance","name":"mnwbfc-25:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.29","timestamp":"2021-07-26T15:41:00.552438681Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_WFvjXFNVu5XDsWgBY7eEpjJ","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314060.554188_364.1","section":"bucket","name":"mnwbfc-25","timestamp":"2021-07-26T15:41:00.554188987Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_TNl0vaUoaZtPgORfA1yoq9r","ver":1},"status":{"status":"write"}}},{"id":"1_1627314060.558136_365.1","section":"bucket","name":"mnwbfc-25","timestamp":"2021-07-26T15:41:00.558136794Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_TNl0vaUoaZtPgORfA1yoq9r","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314060.581432_366.1","section":"bucket.instance","name":"mnwbfc-26:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.30","timestamp":"2021-07-26T15:41:00.581432141Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_vzLxO-aPDULb5aYaW3gv3QK","ver":1},"status":{"status":"write"}}},{"id":"1_1627314060.586485_367.1","section":"bucket.instance","name":"mnwbfc-26:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.30","timestamp":"2021-07-26T15:41:00.586485438Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_vzLxO-aPDULb5aYaW3gv3QK","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314060.588007_368.1","section":"bucket","name":"mnwbfc-26","timestamp":"2021-07-26T15:41:00.588007312Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9fRc-1kZetuXYKxACwTcQJo","ver":1},"status":{"status":"write"}}},{"id":"1_1627314060.591810_369.1","section":"bucket","name":"mnwbfc-26","timestamp":"2021-07-26T15:41:00.591810628Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9fRc-1kZetuXYKxACwTcQJo","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314061.616732_370.1","section":"bucket.instance","name":"mnwbfc-27:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.31","timestamp":"2021-07-26T15:41:01.616732973Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_muqI8DN1pHPYmysZhHuoggz","ver":1},"status":{"status":"write"}}},{"id":"1_1627314061.621808_374.1","section":"bucket.instance","name":"mnwbfc-27:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.31","timestamp":"2021-07-26T15:41:01.621808860Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_muqI8DN1pHPYmysZhHuoggz","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314061.623645_375.1","section":"bucket","name":"mnwbfc-27","timestamp":"2021-07-26T15:41:01.623645348Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_eUvAEUwzcCNwUJDIm6XdQ5U","ver":1},"status":{"status":"write"}}},{"id":"1_1627314061.628278_376.1","section":"bucket","name":"mnwbfc-27","timestamp":"2021-07-26T15:41:01.628278470Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_eUvAEUwzcCNwUJDIm6XdQ5U","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314061.647368_377.1","section":"bucket.instance","name":"mnwbfc-28:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.32","timestamp":"2021-07-26T15:41:01.647368009Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Nxhx9mwT4Tey1S3o1VCNHUT","ver":1},"status":{"status":"write"}}},{"id":"1_1627314061.652109_378.1","section":"bucket.instance","name":"mnwbfc-28:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.32","timestamp":"2021-07-26T15:41:01.652109175Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Nxhx9mwT4Tey1S3o1VCNHUT","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314061.653602_379.1","section":"bucket","name":"mnwbfc-28","timestamp":"2021-07-26T15:41:01.653602848Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_3Rq3IEXf9LYUS2lVQmvsTPj","ver":1},"status":{"status":"write"}}},{"id":"1_1627314061.657210_380.1","section":"bucket","name":"mnwbfc-28","timestamp":"2021-07-26T15:41:01.657210217Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_3Rq3IEXf9LYUS2lVQmvsTPj","ver":1},"status":{"status":"complete"}}},{"id":"1_1627313984.492727_38.1","section":"bucket.instance","name":"mnwbfc-1:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.1","timestamp":"2021-07-26T15:39:44.492727669Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2ilRcecsshsxNNaPkgLCI3m","ver":1},"status":{"status":"write"}}},{"id":"1_1627313984.499402_39.1","section":"bucket.instance","name":"mnwbfc-1:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.1","timestamp":"2021-07-26T15:39:44.499402713Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2ilRcecsshsxNNaPkgLCI3m","ver":1},"status":{"status":"complete"}}},{"id":"1_1627313984.501377_40.1","section":"bucket","name":"mnwbfc-1","timestamp":"2021-07-26T15:39:44.501377383Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_jnfpVQRiScT1NBmYlTlOxVB","ver":1},"status":{"status":"write"}}},{"id":"1_1627313984.505842_41.1","section":"bucket","name":"mnwbfc-1","timestamp":"2021-07-26T15:39:44.505842743Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_jnfpVQRiScT1NBmYlTlOxVB","ver":1},"status":{"status":"complete"}}},{"id":"1_1627313984.529191_43.1","section":"bucket.instance","name":"mnwbfc-2:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.2","timestamp":"2021-07-26T15:39:44.529191622Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_IquMbUIbnzH2ctA6kgPu734","ver":1},"status":{"status":"write"}}},{"id":"1_1627313984.534271_44.1","section":"bucket.instance","name":"mnwbfc-2:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.2","timestamp":"2021-07-26T15:39:44.534271686Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_IquMbUIbnzH2ctA6kgPu734","ver":1},"status":{"status":"complete"}}},{"id":"1_1627313984.536126_45.1","section":"bucket","name":"mnwbfc-2","timestamp":"2021-07-26T15:39:44.536126844Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_1KlPscUVyh-zmo0oMGDjidM","ver":1},"status":{"status":"write"}}},{"id":"1_1627313984.541852_46.1","section":"bucket","name":"mnwbfc-2","timestamp":"2021-07-26T15:39:44.541852358Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_1KlPscUVyh-zmo0oMGDjidM","ver":1},"status":{"status":"complete"}}},{"id":"1_1627313993.734156_48.1","section":"bucket.instance","name":"mnwbfc-3:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.3","timestamp":"2021-07-26T15:39:53.734156015Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_zJml2Si2uL_UsILa0JiFGm1","ver":1},"status":{"status":"write"}}},{"id":"1_1627313993.739347_49.1","section":"bucket.instance","name":"mnwbfc-3:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.3","timestamp":"2021-07-26T15:39:53.739347543Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_zJml2Si2uL_UsILa0JiFGm1","ver":1},"status":{"status":"complete"}}},{"id":"1_1627313993.740848_50.1","section":"bucket","name":"mnwbfc-3","timestamp":"2021-07-26T15:39:53.740848469Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_E0-aaT85V6x7YrlShihVrn0","ver":1},"status":{"status":"write"}}},{"id":"1_1627313993.745663_51.1","section":"bucket","name":"mnwbfc-3","timestamp":"2021-07-26T15:39:53.745663090Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_E0-aaT85V6x7YrlShihVrn0","ver":1},"status":{"status":"complete"}}},{"id":"1_1627313993.766852_52.1","section":"bucket.instance","name":"mnwbfc-4:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.4","timestamp":"2021-07-26T15:39:53.766852268Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_PoPMG_g8Kf-sWpWrl7vzk5V","ver":1},"status":{"status":"write"}}},{"id":"1_1627313993.771992_53.1","section":"bucket.instance","name":"mnwbfc-4:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.4","timestamp":"2021-07-26T15:39:53.771992325Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_PoPMG_g8Kf-sWpWrl7vzk5V","ver":1},"status":{"status":"complete"}}},{"id":"1_1627313993.774106_54.1","section":"bucket","name":"mnwbfc-4","timestamp":"2021-07-26T15:39:53.774106344Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hkJ8rqOsuSMvNUqK4gZez04","ver":1},"status":{"status":"write"}}},{"id":"1_1627313993.780278_55.1","section":"bucket","name":"mnwbfc-4","timestamp":"2021-07-26T15:39:53.780278279Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hkJ8rqOsuSMvNUqK4gZez04","ver":1},"status":{"status":"complete"}}},{"id":"1_1627313994.580924_56.1","section":"bucket.instance","name":"mnwbfc-3:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.5","timestamp":"2021-07-26T15:39:54.580924435Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-soqY3Vbw19XCgtkBGERv4T","ver":1},"status":{"status":"write"}}},{"id":"1_1627313994.586359_57.1","section":"bucket.instance","name":"mnwbfc-3:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.5","timestamp":"2021-07-26T15:39:54.586359373Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-soqY3Vbw19XCgtkBGERv4T","ver":1},"status":{"status":"complete"}}},{"id":"1_1627313994.587962_58.1","section":"bucket","name":"mnwbfc-3","timestamp":"2021-07-26T15:39:54.587962266Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6GegmFQoO9rPS31WmtfnCbz","ver":1},"status":{"status":"write"}}},{"id":"1_1627313994.593508_59.1","section":"bucket","name":"mnwbfc-3","timestamp":"2021-07-26T15:39:54.593508120Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6GegmFQoO9rPS31WmtfnCbz","ver":1},"status":{"status":"abort"}}},{"id":"1_1627313994.627733_60.1","section":"bucket.instance","name":"mnwbfc-4:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.6","timestamp":"2021-07-26T15:39:54.627733013Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Wu5gj-17hEx3CVVrhJmYkY5","ver":1},"status":{"status":"write"}}},{"id":"1_1627313994.633668_61.1","section":"bucket.instance","name":"mnwbfc-4:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.6","timestamp":"2021-07-26T15:39:54.633668481Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Wu5gj-17hEx3CVVrhJmYkY5","ver":1},"status":{"status":"complete"}}},{"id":"1_1627313994.635362_62.1","section":"bucket","name":"mnwbfc-4","timestamp":"2021-07-26T15:39:54.635362508Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_E5iA5grWy3qA5awgEZbYndB","ver":1},"status":{"status":"write"}}},{"id":"1_1627313994.638260_63.1","section":"bucket","name":"mnwbfc-4","timestamp":"2021-07-26T15:39:54.638260613Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_E5iA5grWy3qA5awgEZbYndB","ver":1},"status":{"status":"abort"}}},{"id":"1_1627313994.669674_64.1","section":"bucket.instance","name":"mnwbfc-3:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.7","timestamp":"2021-07-26T15:39:54.669674240Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_T6G9jeWILPwLhmT-IWxg6Sy","ver":1},"status":{"status":"write"}}},{"id":"1_1627313994.677486_65.1","section":"bucket.instance","name":"mnwbfc-3:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.7","timestamp":"2021-07-26T15:39:54.677486939Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_T6G9jeWILPwLhmT-IWxg6Sy","ver":1},"status":{"status":"complete"}}},{"id":"1_1627313994.679129_66.1","section":"bucket","name":"mnwbfc-3","timestamp":"2021-07-26T15:39:54.679129216Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_1GvSeX4WBqTb87NZUI17-S3","ver":1},"status":{"status":"write"}}},{"id":"1_1627313994.684295_67.1","section":"bucket","name":"mnwbfc-3","timestamp":"2021-07-26T15:39:54.684295644Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_1GvSeX4WBqTb87NZUI17-S3","ver":1},"status":{"status":"abort"}}},{"id":"1_1627313994.731706_68.1","section":"bucket.instance","name":"mnwbfc-4:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.8","timestamp":"2021-07-26T15:39:54.731706537Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_aRWQp8c175MBR8VK8xBTNpJ","ver":1},"status":{"status":"write"}}},{"id":"1_1627313994.736433_69.1","section":"bucket.instance","name":"mnwbfc-4:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.8","timestamp":"2021-07-26T15:39:54.736433015Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_aRWQp8c175MBR8VK8xBTNpJ","ver":1},"status":{"status":"complete"}}},{"id":"1_1627313994.738102_70.1","section":"bucket","name":"mnwbfc-4","timestamp":"2021-07-26T15:39:54.738102656Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_anL21ZoU6gc_Prcv7SC1Evs","ver":1},"status":{"status":"write"}}},{"id":"1_1627313994.742358_71.1","section":"bucket","name":"mnwbfc-4","timestamp":"2021-07-26T15:39:54.742358498Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_anL21ZoU6gc_Prcv7SC1Evs","ver":1},"status":{"status":"abort"}}},{"id":"1_1627313995.548854_72.1","section":"bucket.instance","name":"mnwbfc-5:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.9","timestamp":"2021-07-26T15:39:55.548854641Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hWNHb8mt23isTpnkAef-qrf","ver":1},"status":{"status":"write"}}},{"id":"1_1627313995.555062_73.1","section":"bucket.instance","name":"mnwbfc-5:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.9","timestamp":"2021-07-26T15:39:55.555062744Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hWNHb8mt23isTpnkAef-qrf","ver":1},"status":{"status":"complete"}}},{"id":"1_1627313995.557585_74.1","section":"bucket","name":"mnwbfc-5","timestamp":"2021-07-26T15:39:55.557585350Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Vdm38KxNBgJYejwtYav0CYE","ver":1},"status":{"status":"write"}}},{"id":"1_1627313995.563247_75.1","section":"bucket","name":"mnwbfc-5","timestamp":"2021-07-26T15:39:55.563247065Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Vdm38KxNBgJYejwtYav0CYE","ver":1},"status":{"status":"complete"}}},{"id":"1_1627313995.582995_76.1","section":"bucket.instance","name":"mnwbfc-6:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.10","timestamp":"2021-07-26T15:39:55.582995960Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_5xOQRZJPvL1-uIccbISka6S","ver":1},"status":{"status":"write"}}},{"id":"1_1627313995.588805_77.1","section":"bucket.instance","name":"mnwbfc-6:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.10","timestamp":"2021-07-26T15:39:55.588805089Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_5xOQRZJPvL1-uIccbISka6S","ver":1},"status":{"status":"complete"}}},{"id":"1_1627313995.590526_78.1","section":"bucket","name":"mnwbfc-6","timestamp":"2021-07-26T15:39:55.590526426Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Ldhca8J2vigEg3tVrNrb7hT","ver":1},"status":{"status":"write"}}},{"id":"1_1627313995.595921_79.1","section":"bucket","name":"mnwbfc-6","timestamp":"2021-07-26T15:39:55.595921804Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Ldhca8J2vigEg3tVrNrb7hT","ver":1},"status":{"status":"complete"}}},{"id":"1_1627313996.373146_80.1","section":"bucket","name":"mnwbfc-5","timestamp":"2021-07-26T15:39:56.373146182Z","data":{"read_version":{"tag":"_Vdm38KxNBgJYejwtYav0CYE","ver":1},"write_version":{"tag":"_Vdm38KxNBgJYejwtYav0CYE","ver":2},"status":{"status":"remove"}}},{"id":"1_1627313996.378356_81.1","section":"bucket","name":"mnwbfc-5","timestamp":"2021-07-26T15:39:56.378356599Z","data":{"read_version":{"tag":"_Vdm38KxNBgJYejwtYav0CYE","ver":1},"write_version":{"tag":"_Vdm38KxNBgJYejwtYav0CYE","ver":2},"status":{"status":"complete"}}},{"id":"1_1627313996.422081_82.1","section":"bucket","name":"mnwbfc-6","timestamp":"2021-07-26T15:39:56.422081856Z","data":{"read_version":{"tag":"_Ldhca8J2vigEg3tVrNrb7hT","ver":1},"write_version":{"tag":"_Ldhca8J2vigEg3tVrNrb7hT","ver":2},"status":{"status":"remove"}}},{"id":"1_1627313996.427744_83.1","section":"bucket","name":"mnwbfc-6","timestamp":"2021-07-26T15:39:56.427744671Z","data":{"read_version":{"tag":"_Ldhca8J2vigEg3tVrNrb7hT","ver":1},"write_version":{"tag":"_Ldhca8J2vigEg3tVrNrb7hT","ver":2},"status":{"status":"complete"}}},{"id":"1_1627313997.172583_84.1","section":"bucket.instance","name":"mnwbfc-7:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.11","timestamp":"2021-07-26T15:39:57.172583236Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_5Gmt2T1VdYhJtUl3VbnJTK0","ver":1},"status":{"status":"write"}}},{"id":"1_1627313997.177182_85.1","section":"bucket.instance","name":"mnwbfc-7:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.11","timestamp":"2021-07-26T15:39:57.177182954Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_5Gmt2T1VdYhJtUl3VbnJTK0","ver":1},"status":{"status":"complete"}}},{"id":"1_1627313997.178639_86.1","section":"bucket","name":"mnwbfc-7","timestamp":"2021-07-26T15:39:57.178639348Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_A6IlO8VBhrG83SuCJK8Iqxc","ver":1},"status":{"status":"write"}}},{"id":"1_1627313997.182320_87.1","section":"bucket","name":"mnwbfc-7","timestamp":"2021-07-26T15:39:57.182320882Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_A6IlO8VBhrG83SuCJK8Iqxc","ver":1},"status":{"status":"complete"}}},{"id":"1_1627313997.198367_88.1","section":"bucket.instance","name":"mnwbfc-8:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.12","timestamp":"2021-07-26T15:39:57.198367933Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__OrCh6iWWfHmE6JHghp5Rgi","ver":1},"status":{"status":"write"}}},{"id":"1_1627313997.204119_89.1","section":"bucket.instance","name":"mnwbfc-8:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.12","timestamp":"2021-07-26T15:39:57.204119216Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__OrCh6iWWfHmE6JHghp5Rgi","ver":1},"status":{"status":"complete"}}},{"id":"1_1627313997.206473_90.1","section":"bucket","name":"mnwbfc-8","timestamp":"2021-07-26T15:39:57.206473022Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Cs5va6GAqYPmUCZGHa4XxHB","ver":1},"status":{"status":"write"}}},{"id":"1_1627313997.211404_91.1","section":"bucket","name":"mnwbfc-8","timestamp":"2021-07-26T15:39:57.211404600Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Cs5va6GAqYPmUCZGHa4XxHB","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314002.172709_100.1","section":"bucket.instance","name":"mnwbfc-9:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.13","timestamp":"2021-07-26T15:40:02.172709370Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_FsP8YpT0d1-49sbtQ4b-rA5","ver":1},"status":{"status":"write"}}},{"id":"1_1627314002.177056_101.1","section":"bucket.instance","name":"mnwbfc-9:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.13","timestamp":"2021-07-26T15:40:02.177056949Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_FsP8YpT0d1-49sbtQ4b-rA5","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314002.178561_102.1","section":"bucket","name":"mnwbfc-9","timestamp":"2021-07-26T15:40:02.178561306Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_jaUSzYKLfI-6HOoOaBMpLnh","ver":1},"status":{"status":"write"}}},{"id":"1_1627314002.183348_103.1","section":"bucket","name":"mnwbfc-9","timestamp":"2021-07-26T15:40:02.183348090Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_jaUSzYKLfI-6HOoOaBMpLnh","ver":1},"status":{"status":"complete"}}}] 2021-07-26T15:43:13.887 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'list', '--period', '32f6ee58-702f-42e6-a264-989c7d3e6f45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:13.888 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'list', '--period', '32f6ee58-702f-42e6-a264-989c7d3e6f45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:13.889 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog list --period 32f6ee58-702f-42e6-a264-989c7d3e6f45 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:43:13.928 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:43:13.929 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:43:14.117 INFO:teuthology.orchestra.run.smithi183.stdout:[{"id":"1_1627314128.988529_135.1","section":"bucket.instance","name":"mnwbfc-29:1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d.5037.1","timestamp":"2021-07-26T15:42:08.988529121Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_LfibkwuRP0nK3uozxErMfVp","ver":1},"status":{"status":"write"}}},{"id":"1_1627314128.994164_136.1","section":"bucket.instance","name":"mnwbfc-29:1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d.5037.1","timestamp":"2021-07-26T15:42:08.994164835Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_LfibkwuRP0nK3uozxErMfVp","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314128.996078_137.1","section":"bucket","name":"mnwbfc-29","timestamp":"2021-07-26T15:42:08.996078443Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_PP1ycpG-GfmRNji_kdrZs16","ver":1},"status":{"status":"write"}}},{"id":"1_1627314129.002254_138.1","section":"bucket","name":"mnwbfc-29","timestamp":"2021-07-26T15:42:09.002254909Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_PP1ycpG-GfmRNji_kdrZs16","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314129.040115_139.1","section":"bucket.instance","name":"mnwbfc-30:1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d.5037.2","timestamp":"2021-07-26T15:42:09.040115594Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_IROMcn4TA7IptsyZaZavKFn","ver":1},"status":{"status":"write"}}},{"id":"1_1627314129.045738_140.1","section":"bucket.instance","name":"mnwbfc-30:1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d.5037.2","timestamp":"2021-07-26T15:42:09.045738391Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_IROMcn4TA7IptsyZaZavKFn","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314129.047584_141.1","section":"bucket","name":"mnwbfc-30","timestamp":"2021-07-26T15:42:09.047584949Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9pdwNK0zVPoWhV0YJ2YIOaY","ver":1},"status":{"status":"write"}}},{"id":"1_1627314129.051612_142.1","section":"bucket","name":"mnwbfc-30","timestamp":"2021-07-26T15:42:09.051612323Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9pdwNK0zVPoWhV0YJ2YIOaY","ver":1},"status":{"status":"complete"}}}] 2021-07-26T15:43:14.118 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', '32f6ee58-702f-42e6-a264-989c7d3e6f45', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:14.118 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', '32f6ee58-702f-42e6-a264-989c7d3e6f45', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:14.119 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period 32f6ee58-702f-42e6-a264-989c7d3e6f45 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:43:14.155 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:43:14.155 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:43:14.345 INFO:teuthology.orchestra.run.smithi197.stdout:[{"id":"1_1627314128.988529_135.1","section":"bucket.instance","name":"mnwbfc-29:1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d.5037.1","timestamp":"2021-07-26T15:42:08.988529121Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_LfibkwuRP0nK3uozxErMfVp","ver":1},"status":{"status":"write"}}},{"id":"1_1627314128.994164_136.1","section":"bucket.instance","name":"mnwbfc-29:1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d.5037.1","timestamp":"2021-07-26T15:42:08.994164835Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_LfibkwuRP0nK3uozxErMfVp","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314128.996078_137.1","section":"bucket","name":"mnwbfc-29","timestamp":"2021-07-26T15:42:08.996078443Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_PP1ycpG-GfmRNji_kdrZs16","ver":1},"status":{"status":"write"}}},{"id":"1_1627314129.002254_138.1","section":"bucket","name":"mnwbfc-29","timestamp":"2021-07-26T15:42:09.002254909Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_PP1ycpG-GfmRNji_kdrZs16","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314129.040115_139.1","section":"bucket.instance","name":"mnwbfc-30:1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d.5037.2","timestamp":"2021-07-26T15:42:09.040115594Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_IROMcn4TA7IptsyZaZavKFn","ver":1},"status":{"status":"write"}}},{"id":"1_1627314129.045738_140.1","section":"bucket.instance","name":"mnwbfc-30:1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d.5037.2","timestamp":"2021-07-26T15:42:09.045738391Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_IROMcn4TA7IptsyZaZavKFn","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314129.047584_141.1","section":"bucket","name":"mnwbfc-30","timestamp":"2021-07-26T15:42:09.047584949Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9pdwNK0zVPoWhV0YJ2YIOaY","ver":1},"status":{"status":"write"}}},{"id":"1_1627314129.051612_142.1","section":"bucket","name":"mnwbfc-30","timestamp":"2021-07-26T15:42:09.051612323Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9pdwNK0zVPoWhV0YJ2YIOaY","ver":1},"status":{"status":"complete"}}}] 2021-07-26T15:43:14.346 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', '32f6ee58-702f-42e6-a264-989c7d3e6f45', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:14.346 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', '32f6ee58-702f-42e6-a264-989c7d3e6f45', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:14.347 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period 32f6ee58-702f-42e6-a264-989c7d3e6f45 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:43:14.425 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:43:14.426 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:43:14.619 INFO:teuthology.orchestra.run.smithi197.stdout:[{"id":"1_1627314128.988529_135.1","section":"bucket.instance","name":"mnwbfc-29:1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d.5037.1","timestamp":"2021-07-26T15:42:08.988529121Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_LfibkwuRP0nK3uozxErMfVp","ver":1},"status":{"status":"write"}}},{"id":"1_1627314128.994164_136.1","section":"bucket.instance","name":"mnwbfc-29:1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d.5037.1","timestamp":"2021-07-26T15:42:08.994164835Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_LfibkwuRP0nK3uozxErMfVp","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314128.996078_137.1","section":"bucket","name":"mnwbfc-29","timestamp":"2021-07-26T15:42:08.996078443Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_PP1ycpG-GfmRNji_kdrZs16","ver":1},"status":{"status":"write"}}},{"id":"1_1627314129.002254_138.1","section":"bucket","name":"mnwbfc-29","timestamp":"2021-07-26T15:42:09.002254909Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_PP1ycpG-GfmRNji_kdrZs16","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314129.040115_139.1","section":"bucket.instance","name":"mnwbfc-30:1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d.5037.2","timestamp":"2021-07-26T15:42:09.040115594Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_IROMcn4TA7IptsyZaZavKFn","ver":1},"status":{"status":"write"}}},{"id":"1_1627314129.045738_140.1","section":"bucket.instance","name":"mnwbfc-30:1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d.5037.2","timestamp":"2021-07-26T15:42:09.045738391Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_IROMcn4TA7IptsyZaZavKFn","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314129.047584_141.1","section":"bucket","name":"mnwbfc-30","timestamp":"2021-07-26T15:42:09.047584949Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9pdwNK0zVPoWhV0YJ2YIOaY","ver":1},"status":{"status":"write"}}},{"id":"1_1627314129.051612_142.1","section":"bucket","name":"mnwbfc-30","timestamp":"2021-07-26T15:42:09.051612323Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9pdwNK0zVPoWhV0YJ2YIOaY","ver":1},"status":{"status":"complete"}}}] 2021-07-26T15:43:14.620 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'list', '--period', '816a1f73-b2bd-4f0e-a507-b6c39ba8a110', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:14.621 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'list', '--period', '816a1f73-b2bd-4f0e-a507-b6c39ba8a110', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:14.621 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog list --period 816a1f73-b2bd-4f0e-a507-b6c39ba8a110 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:43:14.660 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:43:14.660 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:43:14.844 INFO:teuthology.orchestra.run.smithi183.stdout:[{"id":"1_1627314189.966634_127.1","section":"bucket.instance","name":"mnwbfc-31:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4739.1","timestamp":"2021-07-26T15:43:09.966634579Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9E4VcE0jeiQbklTS5fE4AW0","ver":1},"status":{"status":"write"}}},{"id":"1_1627314189.971416_128.1","section":"bucket.instance","name":"mnwbfc-31:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4739.1","timestamp":"2021-07-26T15:43:09.971416277Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9E4VcE0jeiQbklTS5fE4AW0","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314189.972819_129.1","section":"bucket","name":"mnwbfc-31","timestamp":"2021-07-26T15:43:09.972819204Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_DiC36s2pBF2m_Alou1qDcxq","ver":1},"status":{"status":"write"}}},{"id":"1_1627314189.976509_130.1","section":"bucket","name":"mnwbfc-31","timestamp":"2021-07-26T15:43:09.976509961Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_DiC36s2pBF2m_Alou1qDcxq","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314190.000701_131.1","section":"bucket.instance","name":"mnwbfc-32:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4739.2","timestamp":"2021-07-26T15:43:10.000701624Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_EoZenOVCtFk61pe4OQaMHLE","ver":1},"status":{"status":"write"}}},{"id":"1_1627314190.005928_132.1","section":"bucket.instance","name":"mnwbfc-32:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4739.2","timestamp":"2021-07-26T15:43:10.005928555Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_EoZenOVCtFk61pe4OQaMHLE","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314190.007564_133.1","section":"bucket","name":"mnwbfc-32","timestamp":"2021-07-26T15:43:10.007564384Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_IxVCpDVpjCohrspEeAVjCkj","ver":1},"status":{"status":"write"}}},{"id":"1_1627314190.011527_134.1","section":"bucket","name":"mnwbfc-32","timestamp":"2021-07-26T15:43:10.011527179Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_IxVCpDVpjCohrspEeAVjCkj","ver":1},"status":{"status":"complete"}}}] 2021-07-26T15:43:14.845 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', '816a1f73-b2bd-4f0e-a507-b6c39ba8a110', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:14.845 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', '816a1f73-b2bd-4f0e-a507-b6c39ba8a110', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:14.846 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period 816a1f73-b2bd-4f0e-a507-b6c39ba8a110 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:43:14.883 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:43:14.883 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:43:15.070 INFO:teuthology.orchestra.run.smithi197.stdout:[{"id":"1_1627314189.966634_127.1","section":"bucket.instance","name":"mnwbfc-31:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4739.1","timestamp":"2021-07-26T15:43:09.966634579Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9E4VcE0jeiQbklTS5fE4AW0","ver":1},"status":{"status":"write"}}},{"id":"1_1627314189.971416_128.1","section":"bucket.instance","name":"mnwbfc-31:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4739.1","timestamp":"2021-07-26T15:43:09.971416277Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9E4VcE0jeiQbklTS5fE4AW0","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314189.972819_129.1","section":"bucket","name":"mnwbfc-31","timestamp":"2021-07-26T15:43:09.972819204Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_DiC36s2pBF2m_Alou1qDcxq","ver":1},"status":{"status":"write"}}},{"id":"1_1627314189.976509_130.1","section":"bucket","name":"mnwbfc-31","timestamp":"2021-07-26T15:43:09.976509961Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_DiC36s2pBF2m_Alou1qDcxq","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314190.000701_131.1","section":"bucket.instance","name":"mnwbfc-32:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4739.2","timestamp":"2021-07-26T15:43:10.000701624Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_EoZenOVCtFk61pe4OQaMHLE","ver":1},"status":{"status":"write"}}},{"id":"1_1627314190.005928_132.1","section":"bucket.instance","name":"mnwbfc-32:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4739.2","timestamp":"2021-07-26T15:43:10.005928555Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_EoZenOVCtFk61pe4OQaMHLE","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314190.007564_133.1","section":"bucket","name":"mnwbfc-32","timestamp":"2021-07-26T15:43:10.007564384Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_IxVCpDVpjCohrspEeAVjCkj","ver":1},"status":{"status":"write"}}},{"id":"1_1627314190.011527_134.1","section":"bucket","name":"mnwbfc-32","timestamp":"2021-07-26T15:43:10.011527179Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_IxVCpDVpjCohrspEeAVjCkj","ver":1},"status":{"status":"complete"}}}] 2021-07-26T15:43:15.070 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', '816a1f73-b2bd-4f0e-a507-b6c39ba8a110', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:15.071 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', '816a1f73-b2bd-4f0e-a507-b6c39ba8a110', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:15.072 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period 816a1f73-b2bd-4f0e-a507-b6c39ba8a110 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:43:15.150 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:43:15.151 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:43:15.351 INFO:teuthology.orchestra.run.smithi197.stdout:[{"id":"1_1627314189.966634_127.1","section":"bucket.instance","name":"mnwbfc-31:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4739.1","timestamp":"2021-07-26T15:43:09.966634579Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9E4VcE0jeiQbklTS5fE4AW0","ver":1},"status":{"status":"write"}}},{"id":"1_1627314189.971416_128.1","section":"bucket.instance","name":"mnwbfc-31:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4739.1","timestamp":"2021-07-26T15:43:09.971416277Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9E4VcE0jeiQbklTS5fE4AW0","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314189.972819_129.1","section":"bucket","name":"mnwbfc-31","timestamp":"2021-07-26T15:43:09.972819204Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_DiC36s2pBF2m_Alou1qDcxq","ver":1},"status":{"status":"write"}}},{"id":"1_1627314189.976509_130.1","section":"bucket","name":"mnwbfc-31","timestamp":"2021-07-26T15:43:09.976509961Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_DiC36s2pBF2m_Alou1qDcxq","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314190.000701_131.1","section":"bucket.instance","name":"mnwbfc-32:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4739.2","timestamp":"2021-07-26T15:43:10.000701624Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_EoZenOVCtFk61pe4OQaMHLE","ver":1},"status":{"status":"write"}}},{"id":"1_1627314190.005928_132.1","section":"bucket.instance","name":"mnwbfc-32:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4739.2","timestamp":"2021-07-26T15:43:10.005928555Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_EoZenOVCtFk61pe4OQaMHLE","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314190.007564_133.1","section":"bucket","name":"mnwbfc-32","timestamp":"2021-07-26T15:43:10.007564384Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_IxVCpDVpjCohrspEeAVjCkj","ver":1},"status":{"status":"write"}}},{"id":"1_1627314190.011527_134.1","section":"bucket","name":"mnwbfc-32","timestamp":"2021-07-26T15:43:10.011527179Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_IxVCpDVpjCohrspEeAVjCkj","ver":1},"status":{"status":"complete"}}}] 2021-07-26T15:43:15.351 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'autotrim', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:43:15.352 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'autotrim', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:43:15.353 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog autotrim --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:43:15.388 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:43:15.389 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:43:15.620 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'autotrim', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:43:15.621 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'autotrim', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:43:15.622 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog autotrim --cluster c2 --debug-rgw 0 --debug-ms 0 2021-07-26T15:43:15.657 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:43:15.657 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:43:15.885 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'autotrim', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:43:15.886 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'autotrim', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:43:15.886 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog autotrim --cluster c2 --debug-rgw 0 --debug-ms 0 2021-07-26T15:43:15.962 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:43:15.962 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:43:16.174 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'list', '--period', '973db1f6-3ec7-4bde-a829-51b8cda6e0ef', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:16.175 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'list', '--period', '973db1f6-3ec7-4bde-a829-51b8cda6e0ef', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:16.175 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog list --period 973db1f6-3ec7-4bde-a829-51b8cda6e0ef --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:43:16.212 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:43:16.213 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:43:16.404 INFO:teuthology.orchestra.run.smithi183.stdout:[] 2021-07-26T15:43:16.405 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', '973db1f6-3ec7-4bde-a829-51b8cda6e0ef', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:16.406 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', '973db1f6-3ec7-4bde-a829-51b8cda6e0ef', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:16.406 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period 973db1f6-3ec7-4bde-a829-51b8cda6e0ef --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:43:16.444 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:43:16.444 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:43:16.638 INFO:teuthology.orchestra.run.smithi197.stdout:[] 2021-07-26T15:43:16.639 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', '973db1f6-3ec7-4bde-a829-51b8cda6e0ef', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:16.639 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', '973db1f6-3ec7-4bde-a829-51b8cda6e0ef', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:16.640 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period 973db1f6-3ec7-4bde-a829-51b8cda6e0ef --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:43:16.677 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:43:16.678 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:43:16.862 INFO:teuthology.orchestra.run.smithi197.stdout:[] 2021-07-26T15:43:16.862 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'list', '--period', '32f6ee58-702f-42e6-a264-989c7d3e6f45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:16.863 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'list', '--period', '32f6ee58-702f-42e6-a264-989c7d3e6f45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:16.863 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog list --period 32f6ee58-702f-42e6-a264-989c7d3e6f45 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:43:16.902 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:43:16.903 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:43:17.086 INFO:teuthology.orchestra.run.smithi183.stdout:[] 2021-07-26T15:43:17.087 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', '32f6ee58-702f-42e6-a264-989c7d3e6f45', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:17.088 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', '32f6ee58-702f-42e6-a264-989c7d3e6f45', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:17.088 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period 32f6ee58-702f-42e6-a264-989c7d3e6f45 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:43:17.127 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:43:17.128 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:43:17.324 INFO:teuthology.orchestra.run.smithi197.stdout:[] 2021-07-26T15:43:17.325 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', '32f6ee58-702f-42e6-a264-989c7d3e6f45', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:17.325 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', '32f6ee58-702f-42e6-a264-989c7d3e6f45', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:17.326 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period 32f6ee58-702f-42e6-a264-989c7d3e6f45 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:43:17.364 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:43:17.365 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:43:17.558 INFO:teuthology.orchestra.run.smithi197.stdout:[] 2021-07-26T15:43:17.559 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'list', '--period', '816a1f73-b2bd-4f0e-a507-b6c39ba8a110', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:17.559 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'list', '--period', '816a1f73-b2bd-4f0e-a507-b6c39ba8a110', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:17.560 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog list --period 816a1f73-b2bd-4f0e-a507-b6c39ba8a110 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:43:17.599 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:43:17.599 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:43:17.787 INFO:teuthology.orchestra.run.smithi183.stdout:[] 2021-07-26T15:43:17.788 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', '816a1f73-b2bd-4f0e-a507-b6c39ba8a110', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:17.789 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', '816a1f73-b2bd-4f0e-a507-b6c39ba8a110', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:17.790 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period 816a1f73-b2bd-4f0e-a507-b6c39ba8a110 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:43:17.827 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:43:17.827 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:43:18.023 INFO:teuthology.orchestra.run.smithi197.stdout:[] 2021-07-26T15:43:18.023 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', '816a1f73-b2bd-4f0e-a507-b6c39ba8a110', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:18.024 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', '816a1f73-b2bd-4f0e-a507-b6c39ba8a110', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:18.024 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period 816a1f73-b2bd-4f0e-a507-b6c39ba8a110 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:43:18.101 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:43:18.102 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:43:18.292 INFO:teuthology.orchestra.run.smithi197.stdout:[] 2021-07-26T15:43:18.293 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_multi_period_incremental_sync ... ok 2021-07-26T15:43:18.294 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=mnwbfc-33 2021-07-26T15:43:18.320 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=mnwbfc-34 2021-07-26T15:43:18.391 INFO:tasks.rgw.c2.client.0.smithi197.stdout:2021-07-26T15:43:18.386+0000 7fa8997f2700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:43:18.392 INFO:tasks.rgw.c2.client.1.smithi197.stdout:2021-07-26T15:43:18.386+0000 7f4401ffb700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:43:18.393 INFO:tasks.rgw.c2.client.0.smithi197.stdout:2021-07-26T15:43:18.386+0000 7fa8a77fe700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:43:18.393 INFO:tasks.rgw.c2.client.1.smithi197.stdout:2021-07-26T15:43:18.386+0000 7f43f0fe9700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:43:18.471 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:18.472 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:18.473 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:43:18.508 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:43:18.509 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:43:18.668 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"1_1627314031.129942_132.2","last_update":"2021-07-26T15:40:31.129942Z"},{"marker":"1_1627314198.628187_206.1","last_update":"2021-07-26T15:43:18.628187Z"},{"marker":"1_1627314031.129942_66.3","last_update":"2021-07-26T15:40:31.129942Z"},{"marker":"1_1627314061.532733_328.1","last_update":"2021-07-26T15:41:01.532733Z"}] 2021-07-26T15:43:18.668 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2021-07-26T15:43:18.669 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:18.670 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:18.670 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:43:18.713 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:43:18.713 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:43:18.887 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":18132629931907925738},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314031.129942_132.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:31.129942Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314198.628187_206.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:43:18.628187Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314031.129942_66.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:31.129942Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314061.532733_328.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:41:01.532733Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T15:43:18.888 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2021-07-26T15:43:18.889 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:18.889 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:18.890 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:43:18.929 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:43:18.930 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:43:19.116 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"1_1627314031.129942_132.2","last_update":"2021-07-26T15:40:31.129942Z"},{"marker":"1_1627314198.628187_206.1","last_update":"2021-07-26T15:43:18.628187Z"},{"marker":"1_1627314031.129942_66.3","last_update":"2021-07-26T15:40:31.129942Z"},{"marker":"1_1627314061.532733_328.1","last_update":"2021-07-26T15:41:01.532733Z"}] 2021-07-26T15:43:19.117 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone3 source_zone=test-zone1 2021-07-26T15:43:19.119 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:19.120 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:19.120 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:43:19.163 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:43:19.164 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:43:19.344 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":3487142670906618468},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314031.129942_132.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:31.129942Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314198.628187_206.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:43:18.628187Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314031.129942_66.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:31.129942Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314061.532733_328.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:41:01.532733Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T15:43:19.345 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone3 source_zone=test-zone1 2021-07-26T15:43:19.345 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:19.346 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:19.346 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:43:19.383 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:43:19.383 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:43:19.567 INFO:teuthology.orchestra.run.smithi197.stdout:[{"marker":"1_1627314031.274569_101.2","last_update":"2021-07-26T15:40:31.274569Z"},{"marker":"1_1627314198.446830_202.1","last_update":"2021-07-26T15:43:18.446830Z"},{"marker":"1_1627314031.274569_89.4","last_update":"2021-07-26T15:40:31.274569Z"},{"marker":"1_1627314061.588786_327.1","last_update":"2021-07-26T15:41:01.588786Z"}] 2021-07-26T15:43:19.568 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2021-07-26T15:43:19.569 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:19.569 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:19.570 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:43:19.611 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:43:19.612 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:43:19.801 INFO:teuthology.orchestra.run.smithi183.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":8875080199853872167},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314031.274569_101.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:31.274569Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314198.446830_202.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:43:18.446830Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314031.274569_89.4","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:31.274569Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314061.588786_327.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:41:01.588786Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T15:43:19.803 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2021-07-26T15:43:19.803 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:19.804 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:19.804 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:43:19.879 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:43:19.879 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:43:20.070 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"1_1627314031.129942_132.2","last_update":"2021-07-26T15:40:31.129942Z"},{"marker":"1_1627314198.628187_206.1","last_update":"2021-07-26T15:43:18.628187Z"},{"marker":"1_1627314031.129942_66.3","last_update":"2021-07-26T15:40:31.129942Z"},{"marker":"1_1627314061.532733_328.1","last_update":"2021-07-26T15:41:01.532733Z"}] 2021-07-26T15:43:20.071 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'autotrim', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:43:20.072 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'autotrim', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:43:20.072 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog autotrim --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:43:20.104 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:43:20.104 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:43:20.303 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'list', '--shard-id', '0', '--max-entries', '1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:20.304 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'list', '--shard-id', '0', '--max-entries', '1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:20.304 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog list --shard-id 0 --max-entries 1 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:43:20.343 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:43:20.343 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:43:20.516 INFO:teuthology.orchestra.run.smithi183.stdout:[] 2021-07-26T15:43:20.517 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'list', '--shard-id', '1', '--max-entries', '1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:20.517 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'list', '--shard-id', '1', '--max-entries', '1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:20.518 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog list --shard-id 1 --max-entries 1 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:43:20.601 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:43:20.602 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:43:20.794 INFO:teuthology.orchestra.run.smithi183.stdout:[] 2021-07-26T15:43:20.795 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'list', '--shard-id', '2', '--max-entries', '1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:20.796 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'list', '--shard-id', '2', '--max-entries', '1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:20.796 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog list --shard-id 2 --max-entries 1 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:43:20.835 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:43:20.836 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:43:21.023 INFO:teuthology.orchestra.run.smithi183.stdout:[] 2021-07-26T15:43:21.023 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'list', '--shard-id', '3', '--max-entries', '1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:21.024 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'list', '--shard-id', '3', '--max-entries', '1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:21.024 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog list --shard-id 3 --max-entries 1 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:43:21.064 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:43:21.064 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:43:21.248 INFO:teuthology.orchestra.run.smithi183.stdout:[] 2021-07-26T15:43:21.249 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:21.249 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:21.250 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:43:21.287 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:43:21.288 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:43:21.481 INFO:teuthology.orchestra.run.smithi197.stdout:[{"marker":"1_1627314031.274569_101.2","last_update":"2021-07-26T15:40:31.274569Z"},{"marker":"1_1627314198.446830_202.1","last_update":"2021-07-26T15:43:18.446830Z"},{"marker":"1_1627314031.274569_89.4","last_update":"2021-07-26T15:40:31.274569Z"},{"marker":"1_1627314061.588786_327.1","last_update":"2021-07-26T15:41:01.588786Z"}] 2021-07-26T15:43:21.482 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'autotrim', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:43:21.483 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'autotrim', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:43:21.483 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog autotrim --cluster c2 --debug-rgw 0 --debug-ms 0 2021-07-26T15:43:21.517 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:43:21.517 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:43:21.724 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'list', '--shard-id', '0', '--max-entries', '1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:21.725 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'list', '--shard-id', '0', '--max-entries', '1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:21.725 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog list --shard-id 0 --max-entries 1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:43:21.805 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:43:21.805 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:43:21.990 INFO:teuthology.orchestra.run.smithi197.stdout:[] 2021-07-26T15:43:21.990 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'list', '--shard-id', '1', '--max-entries', '1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:21.991 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'list', '--shard-id', '1', '--max-entries', '1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:21.992 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog list --shard-id 1 --max-entries 1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:43:22.032 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:43:22.033 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:43:22.227 INFO:teuthology.orchestra.run.smithi197.stdout:[] 2021-07-26T15:43:22.228 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'list', '--shard-id', '2', '--max-entries', '1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:22.228 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'list', '--shard-id', '2', '--max-entries', '1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:22.229 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog list --shard-id 2 --max-entries 1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:43:22.309 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:43:22.310 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:43:22.508 INFO:teuthology.orchestra.run.smithi197.stdout:[] 2021-07-26T15:43:22.509 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'list', '--shard-id', '3', '--max-entries', '1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:22.510 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'list', '--shard-id', '3', '--max-entries', '1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:43:22.510 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog list --shard-id 3 --max-entries 1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:43:22.550 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:43:22.550 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:43:22.742 INFO:teuthology.orchestra.run.smithi197.stdout:[] 2021-07-26T15:43:22.743 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_datalog_autotrim ... ok 2021-07-26T15:43:22.744 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--sync-from-all=false', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:43:22.744 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--sync-from-all=false', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:43:22.745 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone modify --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --sync-from-all=false --cluster c2 --debug-rgw 0 --debug-ms 0 2021-07-26T15:43:22.788 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:43:22.789 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:43:22.810 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:43:22.805+0000 7efff6636980 0 failed reading obj info from .rgw.root:zone_info.fdbd535a-3fb6-49cb-8b49-68faf14e40fe: (2) No such file or directory 2021-07-26T15:43:22.810 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:43:22.805+0000 7efff6636980 0 WARNING: could not read zone params for zone id=fdbd535a-3fb6-49cb-8b49-68faf14e40fe name=test-zone1 2021-07-26T15:43:22.821 INFO:teuthology.orchestra.run.smithi197.stdout:{"id":"1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d","name":"test-zone2","domain_root":"test-zone2.rgw.meta:root","control_pool":"test-zone2.rgw.control","gc_pool":"test-zone2.rgw.log:gc","lc_pool":"test-zone2.rgw.log:lc","log_pool":"test-zone2.rgw.log","intent_log_pool":"test-zone2.rgw.log:intent","usage_log_pool":"test-zone2.rgw.log:usage","roles_pool":"test-zone2.rgw.meta:roles","reshard_pool":"test-zone2.rgw.log:reshard","user_keys_pool":"test-zone2.rgw.meta:users.keys","user_email_pool":"test-zone2.rgw.meta:users.email","user_swift_pool":"test-zone2.rgw.meta:users.swift","user_uid_pool":"test-zone2.rgw.meta:users.uid","otp_pool":"test-zone2.rgw.otp","system_key":{"access_key":"ZVEPLG55FHAYZUFC","secret_key":"fSeMFeFOakj53SxFrtZZrsnDzPpkESXF"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone2.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone2.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone2.rgw.buckets.non-ec","index_type":0}}],"realm_id":"d1743e17-c3cb-4823-84fd-b11c05487344"} 2021-07-26T15:43:22.822 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:43:22.822 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:43:22.823 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2021-07-26T15:43:22.907 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:43:22.908 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:43:23.106 INFO:teuthology.orchestra.run.smithi197.stderr:Sending period to new master zone fdbd535a-3fb6-49cb-8b49-68faf14e40fe 2021-07-26T15:43:23.185 INFO:teuthology.orchestra.run.smithi197.stdout:{"id":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","epoch":2,"predecessor_uuid":"32f6ee58-702f-42e6-a264-989c7d3e6f45","sync_status":["","","1_1627314129.051612_142.1",""],"period_map":{"id":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://smithi183.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe","zones":[{"id":"1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d","name":"test-zone2","endpoints":["http://smithi197.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"false","sync_from":[],"redirect_zone":""},{"id":"279e5f25-fca9-4d30-8a59-b5dbb281c553","name":"test-zone3","endpoints":["http://smithi197.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""},{"id":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe","name":"test-zone1","endpoints":["http://smithi183.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"d1743e17-c3cb-4823-84fd-b11c05487344","sync_policy":{"groups":[]}}],"short_zone_ids":[{"key":"1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d","val":841289883},{"key":"279e5f25-fca9-4d30-8a59-b5dbb281c553","val":1085791465},{"key":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe","val":2260121961}]},"master_zonegroup":"test-zonegroup","master_zone":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"d1743e17-c3cb-4823-84fd-b11c05487344","realm_name":"test-realm","realm_epoch":4} 2021-07-26T15:43:23.186 INFO:rgw_multi.tests:Set sync_from_all flag on zone test-zone2 to false 2021-07-26T15:44:23.189 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=mnwbfc-35 2021-07-26T15:44:23.275 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:44:23.276 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:44:23.277 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:44:23.316 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:44:23.317 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:44:23.481 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=816a1f73-b2bd-4f0e-a507-b6c39ba8a110 2021-07-26T15:44:23.511 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314263.224779_155.1","last_update":"2021-07-26T15:44:23.224779Z"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:44:23.512 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:44:23.513 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:44:23.514 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:44:23.515 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:44:23.556 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:44:23.557 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:44:23.741 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314198.344097_143.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:43:18.344097Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:44:23.742 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314263.224779_155.1 target=1_1627314198.344097_143.1 2021-07-26T15:44:28.743 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:44:28.744 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:44:28.744 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:44:28.787 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:44:28.787 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:44:28.975 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314198.344097_143.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:43:18.344097Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:44:28.976 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314263.224779_155.1 target=1_1627314198.344097_143.1 2021-07-26T15:44:33.977 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:44:33.978 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:44:33.979 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:44:34.017 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:44:34.017 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:44:34.219 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314198.344097_143.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:43:18.344097Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:44:34.220 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314263.224779_155.1 target=1_1627314198.344097_143.1 2021-07-26T15:44:39.221 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:44:39.222 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:44:39.223 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:44:39.263 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:44:39.263 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:44:39.455 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314198.344097_143.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:43:18.344097Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:44:39.455 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314263.224779_155.1 target=1_1627314198.344097_143.1 2021-07-26T15:44:44.456 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:44:44.457 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:44:44.458 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:44:44.499 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:44:44.499 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:44:44.688 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314198.344097_143.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:43:18.344097Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:44:44.688 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314263.224779_155.1 target=1_1627314198.344097_143.1 2021-07-26T15:44:49.690 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:44:49.690 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:44:49.691 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:44:49.734 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:44:49.735 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:44:49.902 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314198.344097_143.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:43:18.344097Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:44:49.903 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314263.224779_155.1 target=1_1627314198.344097_143.1 2021-07-26T15:44:54.911 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:44:54.911 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:44:54.912 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:44:54.952 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:44:54.952 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:44:55.142 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314263.224779_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:44:23.224779Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:44:55.143 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:44:55.144 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:44:55.144 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:44:55.145 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:44:55.145 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:44:55.186 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:44:55.187 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:44:55.370 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314198.344097_143.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:43:18.344097Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:44:55.371 WARNING:rgw_multi.tests:zone test-zone3 behind master: shard=2 master=1_1627314263.224779_155.1 target=1_1627314198.344097_143.1 2021-07-26T15:45:00.372 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:45:00.373 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:45:00.374 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:45:00.415 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:45:00.415 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:45:00.598 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314198.344097_143.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:43:18.344097Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:45:00.599 WARNING:rgw_multi.tests:zone test-zone3 behind master: shard=2 master=1_1627314263.224779_155.1 target=1_1627314198.344097_143.1 2021-07-26T15:45:05.600 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:45:05.601 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:45:05.602 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:45:05.642 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:45:05.643 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:45:05.818 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314198.344097_143.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:43:18.344097Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:45:05.819 WARNING:rgw_multi.tests:zone test-zone3 behind master: shard=2 master=1_1627314263.224779_155.1 target=1_1627314198.344097_143.1 2021-07-26T15:45:10.820 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:45:10.821 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:45:10.822 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:45:10.862 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:45:10.862 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:45:11.044 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314198.344097_143.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:43:18.344097Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:45:11.045 WARNING:rgw_multi.tests:zone test-zone3 behind master: shard=2 master=1_1627314263.224779_155.1 target=1_1627314198.344097_143.1 2021-07-26T15:45:16.046 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:45:16.046 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:45:16.048 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:45:16.088 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:45:16.088 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:45:16.274 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314198.344097_143.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:43:18.344097Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:45:16.275 WARNING:rgw_multi.tests:zone test-zone3 behind master: shard=2 master=1_1627314263.224779_155.1 target=1_1627314198.344097_143.1 2021-07-26T15:45:21.276 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:45:21.277 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:45:21.278 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:45:21.319 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:45:21.319 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:45:21.508 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314198.344097_143.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:43:18.344097Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:45:21.508 WARNING:rgw_multi.tests:zone test-zone3 behind master: shard=2 master=1_1627314263.224779_155.1 target=1_1627314198.344097_143.1 2021-07-26T15:45:23.429 INFO:tasks.rgw.c2.client.1.smithi197.stdout:2021-07-26T15:45:23.424+0000 7f43fbfff700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:45:26.510 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:45:26.511 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:45:26.511 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:45:26.553 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:45:26.553 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:45:26.734 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314263.224779_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:44:23.224779Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:45:26.734 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:45:26.752 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--redirect-zone=fdbd535a-3fb6-49cb-8b49-68faf14e40fe', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:45:26.754 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--redirect-zone=fdbd535a-3fb6-49cb-8b49-68faf14e40fe', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:45:26.755 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone modify --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --redirect-zone=fdbd535a-3fb6-49cb-8b49-68faf14e40fe --cluster c2 --debug-rgw 0 --debug-ms 0 2021-07-26T15:45:26.794 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:45:26.795 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:45:26.818 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:45:26.812+0000 7f340af04980 0 failed reading obj info from .rgw.root:zone_info.fdbd535a-3fb6-49cb-8b49-68faf14e40fe: (2) No such file or directory 2021-07-26T15:45:26.818 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:45:26.812+0000 7f340af04980 0 WARNING: could not read zone params for zone id=fdbd535a-3fb6-49cb-8b49-68faf14e40fe name=test-zone1 2021-07-26T15:45:26.826 INFO:teuthology.orchestra.run.smithi197.stdout:{"id":"1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d","name":"test-zone2","domain_root":"test-zone2.rgw.meta:root","control_pool":"test-zone2.rgw.control","gc_pool":"test-zone2.rgw.log:gc","lc_pool":"test-zone2.rgw.log:lc","log_pool":"test-zone2.rgw.log","intent_log_pool":"test-zone2.rgw.log:intent","usage_log_pool":"test-zone2.rgw.log:usage","roles_pool":"test-zone2.rgw.meta:roles","reshard_pool":"test-zone2.rgw.log:reshard","user_keys_pool":"test-zone2.rgw.meta:users.keys","user_email_pool":"test-zone2.rgw.meta:users.email","user_swift_pool":"test-zone2.rgw.meta:users.swift","user_uid_pool":"test-zone2.rgw.meta:users.uid","otp_pool":"test-zone2.rgw.otp","system_key":{"access_key":"ZVEPLG55FHAYZUFC","secret_key":"fSeMFeFOakj53SxFrtZZrsnDzPpkESXF"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone2.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone2.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone2.rgw.buckets.non-ec","index_type":0}}],"realm_id":"d1743e17-c3cb-4823-84fd-b11c05487344"} 2021-07-26T15:45:26.826 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:45:26.827 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:45:26.828 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2021-07-26T15:45:26.903 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:45:26.904 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:45:27.094 INFO:teuthology.orchestra.run.smithi197.stderr:Sending period to new master zone fdbd535a-3fb6-49cb-8b49-68faf14e40fe 2021-07-26T15:45:27.170 INFO:teuthology.orchestra.run.smithi197.stdout:{"id":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","epoch":3,"predecessor_uuid":"32f6ee58-702f-42e6-a264-989c7d3e6f45","sync_status":["","","1_1627314129.051612_142.1",""],"period_map":{"id":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://smithi183.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe","zones":[{"id":"1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d","name":"test-zone2","endpoints":["http://smithi197.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"false","sync_from":[],"redirect_zone":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe"},{"id":"279e5f25-fca9-4d30-8a59-b5dbb281c553","name":"test-zone3","endpoints":["http://smithi197.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""},{"id":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe","name":"test-zone1","endpoints":["http://smithi183.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"d1743e17-c3cb-4823-84fd-b11c05487344","sync_policy":{"groups":[]}}],"short_zone_ids":[{"key":"1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d","val":841289883},{"key":"279e5f25-fca9-4d30-8a59-b5dbb281c553","val":1085791465},{"key":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe","val":2260121961}]},"master_zonegroup":"test-zonegroup","master_zone":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"d1743e17-c3cb-4823-84fd-b11c05487344","realm_name":"test-realm","realm_epoch":4} 2021-07-26T15:45:27.171 INFO:rgw_multi.tests:Set redirect_zone zone test-zone2 to "fdbd535a-3fb6-49cb-8b49-68faf14e40fe" 2021-07-26T15:46:27.517 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--sync-from-all=true', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:46:27.518 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--sync-from-all=true', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:46:27.519 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone modify --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --sync-from-all=true --cluster c2 --debug-rgw 0 --debug-ms 0 2021-07-26T15:46:27.560 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:46:27.560 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:46:27.590 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:46:27.583+0000 7f7e0038c980 0 failed reading obj info from .rgw.root:zone_info.fdbd535a-3fb6-49cb-8b49-68faf14e40fe: (2) No such file or directory 2021-07-26T15:46:27.591 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:46:27.583+0000 7f7e0038c980 0 WARNING: could not read zone params for zone id=fdbd535a-3fb6-49cb-8b49-68faf14e40fe name=test-zone1 2021-07-26T15:46:27.601 INFO:teuthology.orchestra.run.smithi197.stdout:{"id":"1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d","name":"test-zone2","domain_root":"test-zone2.rgw.meta:root","control_pool":"test-zone2.rgw.control","gc_pool":"test-zone2.rgw.log:gc","lc_pool":"test-zone2.rgw.log:lc","log_pool":"test-zone2.rgw.log","intent_log_pool":"test-zone2.rgw.log:intent","usage_log_pool":"test-zone2.rgw.log:usage","roles_pool":"test-zone2.rgw.meta:roles","reshard_pool":"test-zone2.rgw.log:reshard","user_keys_pool":"test-zone2.rgw.meta:users.keys","user_email_pool":"test-zone2.rgw.meta:users.email","user_swift_pool":"test-zone2.rgw.meta:users.swift","user_uid_pool":"test-zone2.rgw.meta:users.uid","otp_pool":"test-zone2.rgw.otp","system_key":{"access_key":"ZVEPLG55FHAYZUFC","secret_key":"fSeMFeFOakj53SxFrtZZrsnDzPpkESXF"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone2.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone2.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone2.rgw.buckets.non-ec","index_type":0}}],"realm_id":"d1743e17-c3cb-4823-84fd-b11c05487344"} 2021-07-26T15:46:27.602 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:46:27.603 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:46:27.607 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2021-07-26T15:46:27.681 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:46:27.682 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:46:27.890 INFO:teuthology.orchestra.run.smithi197.stderr:Sending period to new master zone fdbd535a-3fb6-49cb-8b49-68faf14e40fe 2021-07-26T15:46:27.986 INFO:teuthology.orchestra.run.smithi197.stdout:{"id":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","epoch":4,"predecessor_uuid":"32f6ee58-702f-42e6-a264-989c7d3e6f45","sync_status":["","","1_1627314129.051612_142.1",""],"period_map":{"id":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://smithi183.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe","zones":[{"id":"1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d","name":"test-zone2","endpoints":["http://smithi197.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe"},{"id":"279e5f25-fca9-4d30-8a59-b5dbb281c553","name":"test-zone3","endpoints":["http://smithi197.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""},{"id":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe","name":"test-zone1","endpoints":["http://smithi183.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"d1743e17-c3cb-4823-84fd-b11c05487344","sync_policy":{"groups":[]}}],"short_zone_ids":[{"key":"1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d","val":841289883},{"key":"279e5f25-fca9-4d30-8a59-b5dbb281c553","val":1085791465},{"key":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe","val":2260121961}]},"master_zonegroup":"test-zonegroup","master_zone":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"d1743e17-c3cb-4823-84fd-b11c05487344","realm_name":"test-realm","realm_epoch":4} 2021-07-26T15:46:27.987 INFO:rgw_multi.tests:Set sync_from_all flag on zone test-zone2 to true 2021-07-26T15:47:27.991 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--redirect-zone=', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:47:27.992 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--redirect-zone=', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:47:27.993 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone modify --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --redirect-zone= --cluster c2 --debug-rgw 0 --debug-ms 0 2021-07-26T15:47:28.042 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:47:28.043 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:47:28.071 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:47:28.065+0000 7f1adfa4e980 0 failed reading obj info from .rgw.root:zone_info.fdbd535a-3fb6-49cb-8b49-68faf14e40fe: (2) No such file or directory 2021-07-26T15:47:28.072 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:47:28.065+0000 7f1adfa4e980 0 WARNING: could not read zone params for zone id=fdbd535a-3fb6-49cb-8b49-68faf14e40fe name=test-zone1 2021-07-26T15:47:28.088 INFO:teuthology.orchestra.run.smithi197.stdout:{"id":"1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d","name":"test-zone2","domain_root":"test-zone2.rgw.meta:root","control_pool":"test-zone2.rgw.control","gc_pool":"test-zone2.rgw.log:gc","lc_pool":"test-zone2.rgw.log:lc","log_pool":"test-zone2.rgw.log","intent_log_pool":"test-zone2.rgw.log:intent","usage_log_pool":"test-zone2.rgw.log:usage","roles_pool":"test-zone2.rgw.meta:roles","reshard_pool":"test-zone2.rgw.log:reshard","user_keys_pool":"test-zone2.rgw.meta:users.keys","user_email_pool":"test-zone2.rgw.meta:users.email","user_swift_pool":"test-zone2.rgw.meta:users.swift","user_uid_pool":"test-zone2.rgw.meta:users.uid","otp_pool":"test-zone2.rgw.otp","system_key":{"access_key":"ZVEPLG55FHAYZUFC","secret_key":"fSeMFeFOakj53SxFrtZZrsnDzPpkESXF"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone2.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone2.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone2.rgw.buckets.non-ec","index_type":0}}],"realm_id":"d1743e17-c3cb-4823-84fd-b11c05487344"} 2021-07-26T15:47:28.089 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:47:28.089 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:47:28.091 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2021-07-26T15:47:28.169 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:47:28.170 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:47:28.382 INFO:teuthology.orchestra.run.smithi197.stderr:Sending period to new master zone fdbd535a-3fb6-49cb-8b49-68faf14e40fe 2021-07-26T15:47:28.453 INFO:teuthology.orchestra.run.smithi197.stdout:{"id":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","epoch":5,"predecessor_uuid":"32f6ee58-702f-42e6-a264-989c7d3e6f45","sync_status":["","","1_1627314129.051612_142.1",""],"period_map":{"id":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://smithi183.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe","zones":[{"id":"1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d","name":"test-zone2","endpoints":["http://smithi197.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"279e5f25-fca9-4d30-8a59-b5dbb281c553","name":"test-zone3","endpoints":["http://smithi197.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""},{"id":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe","name":"test-zone1","endpoints":["http://smithi183.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"d1743e17-c3cb-4823-84fd-b11c05487344","sync_policy":{"groups":[]}}],"short_zone_ids":[{"key":"1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d","val":841289883},{"key":"279e5f25-fca9-4d30-8a59-b5dbb281c553","val":1085791465},{"key":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe","val":2260121961}]},"master_zonegroup":"test-zonegroup","master_zone":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"d1743e17-c3cb-4823-84fd-b11c05487344","realm_name":"test-realm","realm_epoch":4} 2021-07-26T15:47:28.454 INFO:rgw_multi.tests:Set redirect_zone zone test-zone2 to "" 2021-07-26T15:48:28.456 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_multi_zone_redirect ... ok 2021-07-26T15:48:28.458 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:48:28.459 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:48:28.460 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:48:28.497 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:48:28.498 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:48:28.654 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=816a1f73-b2bd-4f0e-a507-b6c39ba8a110 2021-07-26T15:48:28.682 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314263.224779_155.1","last_update":"2021-07-26T15:44:23.224779Z"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:48:28.683 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:48:28.684 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:48:28.684 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:48:28.685 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:48:28.724 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:48:28.725 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:48:28.930 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314263.224779_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:44:23.224779Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:48:28.931 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:48:28.932 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:48:28.932 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:48:28.933 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:48:28.933 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:48:28.984 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:48:28.985 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:48:29.172 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314263.224779_155.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:44:23.224779Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:48:29.172 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:48:29.173 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'create', '--rgw-zone', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--access-key', 'ZVEPLG55FHAYZUFC', '--secret', 'fSeMFeFOakj53SxFrtZZrsnDzPpkESXF', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:48:29.173 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'create', '--rgw-zone', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--access-key', 'ZVEPLG55FHAYZUFC', '--secret', 'fSeMFeFOakj53SxFrtZZrsnDzPpkESXF', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:48:29.174 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone create --rgw-zone remove --rgw-zonegroup test-zonegroup --rgw-realm test-realm --access-key ZVEPLG55FHAYZUFC --secret fSeMFeFOakj53SxFrtZZrsnDzPpkESXF --cluster c2 --debug-rgw 0 --debug-ms 0 2021-07-26T15:48:29.255 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:48:29.256 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:48:29.319 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:48:29.316+0000 7fef73b65980 0 failed reading obj info from .rgw.root:zone_info.fdbd535a-3fb6-49cb-8b49-68faf14e40fe: (2) No such file or directory 2021-07-26T15:48:29.319 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:48:29.316+0000 7fef73b65980 0 WARNING: could not read zone params for zone id=fdbd535a-3fb6-49cb-8b49-68faf14e40fe name=test-zone1 2021-07-26T15:48:29.329 INFO:teuthology.orchestra.run.smithi197.stdout:{"id":"c001ebd0-36b3-4da8-bc2b-05891d8c9b67","name":"remove","domain_root":"remove.rgw.meta:root","control_pool":"remove.rgw.control","gc_pool":"remove.rgw.log:gc","lc_pool":"remove.rgw.log:lc","log_pool":"remove.rgw.log","intent_log_pool":"remove.rgw.log:intent","usage_log_pool":"remove.rgw.log:usage","roles_pool":"remove.rgw.meta:roles","reshard_pool":"remove.rgw.log:reshard","user_keys_pool":"remove.rgw.meta:users.keys","user_email_pool":"remove.rgw.meta:users.email","user_swift_pool":"remove.rgw.meta:users.swift","user_uid_pool":"remove.rgw.meta:users.uid","otp_pool":"remove.rgw.otp","system_key":{"access_key":"ZVEPLG55FHAYZUFC","secret_key":"fSeMFeFOakj53SxFrtZZrsnDzPpkESXF"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"remove.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"remove.rgw.buckets.data"}},"data_extra_pool":"remove.rgw.buckets.non-ec","index_type":0}}],"realm_id":"d1743e17-c3cb-4823-84fd-b11c05487344"} 2021-07-26T15:48:29.330 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:48:29.330 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:48:29.331 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone remove --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2021-07-26T15:48:29.371 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:48:29.371 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:48:37.481 INFO:teuthology.orchestra.run.smithi197.stderr:Sending period to new master zone fdbd535a-3fb6-49cb-8b49-68faf14e40fe 2021-07-26T15:48:37.553 INFO:teuthology.orchestra.run.smithi197.stdout:{"id":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","epoch":6,"predecessor_uuid":"32f6ee58-702f-42e6-a264-989c7d3e6f45","sync_status":["","","1_1627314129.051612_142.1",""],"period_map":{"id":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://smithi183.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe","zones":[{"id":"1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d","name":"test-zone2","endpoints":["http://smithi197.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"279e5f25-fca9-4d30-8a59-b5dbb281c553","name":"test-zone3","endpoints":["http://smithi197.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""},{"id":"c001ebd0-36b3-4da8-bc2b-05891d8c9b67","name":"remove","endpoints":[],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe","name":"test-zone1","endpoints":["http://smithi183.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"d1743e17-c3cb-4823-84fd-b11c05487344","sync_policy":{"groups":[]}}],"short_zone_ids":[{"key":"1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d","val":841289883},{"key":"279e5f25-fca9-4d30-8a59-b5dbb281c553","val":1085791465},{"key":"c001ebd0-36b3-4da8-bc2b-05891d8c9b67","val":3848914400},{"key":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe","val":2260121961}]},"master_zonegroup":"test-zonegroup","master_zone":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"d1743e17-c3cb-4823-84fd-b11c05487344","realm_name":"test-realm","realm_epoch":4} 2021-07-26T15:48:37.554 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zonegroup', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--rgw-zone', 'remove', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:48:37.555 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zonegroup', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--rgw-zone', 'remove', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:48:37.556 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zonegroup remove --rgw-zonegroup test-zonegroup --rgw-realm test-realm --rgw-zone remove --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:48:37.598 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:48:37.599 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:48:37.620 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:48:37.615+0000 7fd047716980 0 failed reading obj info from .rgw.root:zone_info.1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d: (2) No such file or directory 2021-07-26T15:48:37.620 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:48:37.615+0000 7fd047716980 0 WARNING: could not read zone params for zone id=1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d name=test-zone2 2021-07-26T15:48:37.620 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:48:37.615+0000 7fd047716980 0 failed reading obj info from .rgw.root:zone_info.279e5f25-fca9-4d30-8a59-b5dbb281c553: (2) No such file or directory 2021-07-26T15:48:37.621 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:48:37.615+0000 7fd047716980 0 WARNING: could not read zone params for zone id=279e5f25-fca9-4d30-8a59-b5dbb281c553 name=test-zone3 2021-07-26T15:48:37.629 INFO:teuthology.orchestra.run.smithi183.stdout:{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://smithi183.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe","zones":[{"id":"1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d","name":"test-zone2","endpoints":["http://smithi197.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"279e5f25-fca9-4d30-8a59-b5dbb281c553","name":"test-zone3","endpoints":["http://smithi197.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""},{"id":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe","name":"test-zone1","endpoints":["http://smithi183.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"d1743e17-c3cb-4823-84fd-b11c05487344","sync_policy":{"groups":[]}} 2021-07-26T15:48:37.630 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zonegroup', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--rgw-zone', 'remove', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:48:37.630 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zonegroup', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--rgw-zone', 'remove', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:48:37.631 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zonegroup remove --rgw-zonegroup test-zonegroup --rgw-realm test-realm --rgw-zone remove --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:48:37.710 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:48:37.711 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:48:37.729 INFO:teuthology.orchestra.run.smithi183.stderr:zone name remove not found in zonegroup test-zonegroup 2021-07-26T15:48:37.737 DEBUG:teuthology.orchestra.run:got remote process result: 2 2021-07-26T15:48:37.738 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'delete', '--rgw-zone', 'remove', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:48:37.739 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'delete', '--rgw-zone', 'remove', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:48:37.739 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone delete --rgw-zone remove --cluster c2 --debug-rgw 0 --debug-ms 0 2021-07-26T15:48:37.779 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:48:37.779 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:48:37.832 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:48:37.828+0000 7f8c820aa980 0 failed reading obj info from .rgw.root:zone_info.fdbd535a-3fb6-49cb-8b49-68faf14e40fe: (2) No such file or directory 2021-07-26T15:48:37.833 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:48:37.828+0000 7f8c820aa980 0 WARNING: could not read zone params for zone id=fdbd535a-3fb6-49cb-8b49-68faf14e40fe name=test-zone1 2021-07-26T15:48:37.835 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T15:48:37.832+0000 7f8c820aa980 0 zone id c001ebd0-36b3-4da8-bc2b-05891d8c9b67 is not a part of zonegroup default 2021-07-26T15:48:37.845 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:48:37.846 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:48:37.846 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 period update --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:48:37.890 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:48:37.890 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:48:37.931 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:48:37.927+0000 7fcf11e7f980 0 WARNING: can't generate connection for zone c001ebd0-36b3-4da8-bc2b-05891d8c9b67 id remove: no endpoints defined 2021-07-26T15:48:38.142 INFO:teuthology.orchestra.run.smithi183.stdout:{"id":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","epoch":7,"predecessor_uuid":"32f6ee58-702f-42e6-a264-989c7d3e6f45","sync_status":["","","1_1627314129.051612_142.1",""],"period_map":{"id":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://smithi183.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe","zones":[{"id":"1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d","name":"test-zone2","endpoints":["http://smithi197.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"279e5f25-fca9-4d30-8a59-b5dbb281c553","name":"test-zone3","endpoints":["http://smithi197.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""},{"id":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe","name":"test-zone1","endpoints":["http://smithi183.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"d1743e17-c3cb-4823-84fd-b11c05487344","sync_policy":{"groups":[]}}],"short_zone_ids":[{"key":"1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d","val":841289883},{"key":"279e5f25-fca9-4d30-8a59-b5dbb281c553","val":1085791465},{"key":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe","val":2260121961}]},"master_zonegroup":"test-zonegroup","master_zone":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"d1743e17-c3cb-4823-84fd-b11c05487344","realm_name":"test-realm","realm_epoch":4} 2021-07-26T15:48:38.143 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_zonegroup_remove ... ok 2021-07-26T15:48:38.145 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zonegroup', 'create', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:48:38.146 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zonegroup', 'create', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:48:38.147 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zonegroup create --rgw-zonegroup remove_zg --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:48:38.183 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:48:38.184 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:48:38.213 INFO:teuthology.orchestra.run.smithi183.stdout:{"id":"c1915463-6dc8-4d56-b3e7-b34622f18273","name":"remove_zg","api_name":"remove_zg","is_master":"false","endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"","zones":[],"placement_targets":[],"default_placement":"","realm_id":"d1743e17-c3cb-4823-84fd-b11c05487344","sync_policy":{"groups":[]}} 2021-07-26T15:48:38.214 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'create', '--rgw-zone', 'remove', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:48:38.214 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'create', '--rgw-zone', 'remove', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:48:38.215 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone create --rgw-zone remove --rgw-zonegroup remove_zg --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:48:38.295 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:48:38.295 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:48:38.349 INFO:teuthology.orchestra.run.smithi183.stdout:{"id":"bf9629df-2033-4497-9b65-7eff440cac04","name":"remove","domain_root":"remove.rgw.meta:root","control_pool":"remove.rgw.control","gc_pool":"remove.rgw.log:gc","lc_pool":"remove.rgw.log:lc","log_pool":"remove.rgw.log","intent_log_pool":"remove.rgw.log:intent","usage_log_pool":"remove.rgw.log:usage","roles_pool":"remove.rgw.meta:roles","reshard_pool":"remove.rgw.log:reshard","user_keys_pool":"remove.rgw.meta:users.keys","user_email_pool":"remove.rgw.meta:users.email","user_swift_pool":"remove.rgw.meta:users.swift","user_uid_pool":"remove.rgw.meta:users.uid","otp_pool":"remove.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"remove.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"remove.rgw.buckets.data"}},"data_extra_pool":"remove.rgw.buckets.non-ec","index_type":0}}],"realm_id":"d1743e17-c3cb-4823-84fd-b11c05487344"} 2021-07-26T15:48:38.350 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:48:38.350 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:48:38.351 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 period update --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:48:38.393 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:48:38.394 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:48:38.650 INFO:teuthology.orchestra.run.smithi183.stdout:{"id":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","epoch":8,"predecessor_uuid":"32f6ee58-702f-42e6-a264-989c7d3e6f45","sync_status":["","","1_1627314129.051612_142.1",""],"period_map":{"id":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","zonegroups":[{"id":"c1915463-6dc8-4d56-b3e7-b34622f18273","name":"remove_zg","api_name":"remove_zg","is_master":"false","endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"bf9629df-2033-4497-9b65-7eff440cac04","zones":[{"id":"bf9629df-2033-4497-9b65-7eff440cac04","name":"remove","endpoints":[],"log_meta":"false","log_data":"false","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"d1743e17-c3cb-4823-84fd-b11c05487344","sync_policy":{"groups":[]}},{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://smithi183.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe","zones":[{"id":"1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d","name":"test-zone2","endpoints":["http://smithi197.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"279e5f25-fca9-4d30-8a59-b5dbb281c553","name":"test-zone3","endpoints":["http://smithi197.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""},{"id":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe","name":"test-zone1","endpoints":["http://smithi183.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"d1743e17-c3cb-4823-84fd-b11c05487344","sync_policy":{"groups":[]}}],"short_zone_ids":[{"key":"1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d","val":841289883},{"key":"279e5f25-fca9-4d30-8a59-b5dbb281c553","val":1085791465},{"key":"bf9629df-2033-4497-9b65-7eff440cac04","val":1709564836},{"key":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe","val":2260121961}]},"master_zonegroup":"test-zonegroup","master_zone":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"d1743e17-c3cb-4823-84fd-b11c05487344","realm_name":"test-realm","realm_epoch":4} 2021-07-26T15:48:38.650 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'delete', '--rgw-zone', 'remove', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:48:38.651 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'delete', '--rgw-zone', 'remove', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:48:38.652 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone delete --rgw-zone remove --rgw-zonegroup remove_zg --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:48:38.689 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:48:38.690 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:48:38.731 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:48:38.727+0000 7f9873c80980 0 zone id bf9629df-2033-4497-9b65-7eff440cac04 is not a part of zonegroup test-zonegroup 2021-07-26T15:48:38.732 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:48:38.727+0000 7f9873c80980 0 zone id bf9629df-2033-4497-9b65-7eff440cac04 is not a part of zonegroup default 2021-07-26T15:48:38.745 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:48:38.745 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:48:38.746 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 period update --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:48:38.823 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:48:38.823 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:48:38.862 INFO:teuthology.orchestra.run.smithi183.stderr:2021-07-26T15:48:38.859+0000 7f292adbd980 0 ERROR: zonegroup remove_zg has a non existent master zone 2021-07-26T15:48:38.869 DEBUG:teuthology.orchestra.run:got remote process result: 22 2021-07-26T15:48:38.870 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zonegroup', 'delete', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:48:38.871 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zonegroup', 'delete', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:48:38.871 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zonegroup delete --rgw-zonegroup remove_zg --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:48:38.904 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:48:38.905 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:48:38.935 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:48:38.936 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:48:38.936 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 period update --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:48:38.974 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:48:38.974 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:48:39.195 INFO:teuthology.orchestra.run.smithi183.stdout:{"id":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","epoch":9,"predecessor_uuid":"32f6ee58-702f-42e6-a264-989c7d3e6f45","sync_status":["","","1_1627314129.051612_142.1",""],"period_map":{"id":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://smithi183.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe","zones":[{"id":"1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d","name":"test-zone2","endpoints":["http://smithi197.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"279e5f25-fca9-4d30-8a59-b5dbb281c553","name":"test-zone3","endpoints":["http://smithi197.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""},{"id":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe","name":"test-zone1","endpoints":["http://smithi183.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"d1743e17-c3cb-4823-84fd-b11c05487344","sync_policy":{"groups":[]}}],"short_zone_ids":[{"key":"1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d","val":841289883},{"key":"279e5f25-fca9-4d30-8a59-b5dbb281c553","val":1085791465},{"key":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe","val":2260121961}]},"master_zonegroup":"test-zonegroup","master_zone":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"d1743e17-c3cb-4823-84fd-b11c05487344","realm_name":"test-realm","realm_epoch":4} 2021-07-26T15:48:39.196 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_zg_master_zone_delete ... ok 2021-07-26T15:48:39.197 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=mnwbfc-36 2021-07-26T15:48:39.372 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=mnwbfc-37 2021-07-26T15:48:39.713 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=mnwbfc-38 2021-07-26T15:48:39.740 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=mnwbfc-39 2021-07-26T15:48:40.907 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_set_bucket_website ... rgw_multi.tests.test_set_bucket_policy ... ok 2021-07-26T15:48:40.908 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=mnwbfc-40 2021-07-26T15:48:40.936 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=mnwbfc-41 2021-07-26T15:48:40.988 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'disable', '--bucket', 'mnwbfc-40', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:48:40.989 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'disable', '--bucket', 'mnwbfc-40', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:48:40.990 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync disable --bucket mnwbfc-40 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:48:41.030 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:48:41.030 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:48:41.268 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'disable', '--bucket', 'mnwbfc-41', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:48:41.269 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'disable', '--bucket', 'mnwbfc-41', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:48:41.269 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync disable --bucket mnwbfc-41 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:48:41.309 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:48:41.309 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:48:41.559 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['log', 'list', '--rgw-zone', 'test-zone1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:48:41.559 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'log', 'list', '--rgw-zone', 'test-zone1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:48:41.560 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 log list --rgw-zone test-zone1 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:48:41.636 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:48:41.637 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:48:41.847 INFO:teuthology.orchestra.run.smithi183.stdout:["obj_delete_at_hint.0000000078","meta.history","obj_delete_at_hint.0000000070","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.10-mnwbfc-6","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","bucket.sync-status.1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d:mnwbfc-15:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.19:8","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.9-mnwbfc-5","bucket.sync-status.1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d:mnwbfc-13:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.17:8","obj_delete_at_hint.0000000040","datalog.sync-status.shard.1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d.0","meta.full-sync.index.0","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.11-mnwbfc-7","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","bucket.sync-status.1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d:mnwbfc-34:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4739.4:8","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4739.1-mnwbfc-31","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.22-mnwbfc-18","obj_delete_at_hint.0000000024","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.17-mnwbfc-13","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","data_log.3","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.4-mnwbfc-4","bucket.sync-status.1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d:mnwbfc-25:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.29:10","bucket.sync-status.1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d:mnwbfc-11:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.15:3","data.full-sync.index.1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d.0","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.14-mnwbfc-10","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.18-mnwbfc-14","obj_delete_at_hint.0000000088","meta.log.816a1f73-b2bd-4f0e-a507-b6c39ba8a110.2","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","bucket.sync-status.1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d:mnwbfc-8:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.12:3","datalog.sync-status.shard.1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d.2","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","datalog.sync-status.shard.1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d.1","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4939.6-mnwbfc-41","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","bucket.sync-status.1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d:mnwbfc-8:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.12:7","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4939.5-mnwbfc-40","bilog.trim","obj_delete_at_hint.0000000016","bucket.sync-status.1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d:mnwbfc-17:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.21:8","obj_delete_at_hint.0000000041","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","bucket.sync-status.1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d:mnwbfc-26:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.30:10","obj_delete_at_hint.0000000014","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4739.2-mnwbfc-32","data_log.1","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.30-mnwbfc-26","obj_delete_at_hint.0000000125","2021-07-26-15-1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d.5037.1-mnwbfc-29","obj_delete_at_hint.0000000082","meta.full-sync.index.1","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.28-mnwbfc-24","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","bucket.sync-status.1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d:mnwbfc-8:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.12:1","datalog.sync-status.shard.1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d.3","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.1-mnwbfc-1","mdlog.sync-status.shard.2","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4939.4-mnwbfc-39","datalog.sync-status.1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","obj_delete_at_hint.0000000116","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.13-mnwbfc-9","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.12-mnwbfc-8","bucket.sync-status.1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d:mnwbfc-12:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.16:1","mdlog.sync-status.shard.1","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.19-mnwbfc-15","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","bucket.sync-status.1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d:mnwbfc-7:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.11:7","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.26-mnwbfc-22","obj_delete_at_hint.0000000066","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.15-mnwbfc-11","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4739.3-mnwbfc-33","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","datalog.sync-status.shard.1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d.2.retry","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","meta.full-sync.index.3","obj_delete_at_hint.0000000118","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.25-mnwbfc-21","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.29-mnwbfc-25","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","mdlog.sync-status.shard.3","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.2-mnwbfc-2","bucket.sync-status.1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d:mnwbfc-18:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.22:8","mdlog.sync-status.shard.0","obj_delete_at_hint.0000000027","mdlog.sync-status","obj_delete_at_hint.0000000019","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4845.1-mnwbfc-35","obj_delete_at_hint.0000000039","bucket.sync-status.1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d:mnwbfc-13:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.17:5","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.21-mnwbfc-17","obj_delete_at_hint.0000000100","datalog.sync-status.shard.1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d.1.retry","obj_delete_at_hint.0000000093","bucket.sync-status.1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d:mnwbfc-9:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.13:1","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","bucket.sync-status.1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d:mnwbfc-11:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.15:1","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","data_log.0","bucket.sync-status.1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d:mnwbfc-16:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.20:8","obj_delete_at_hint.0000000012","bucket.sync-status.1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d:mnwbfc-10:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.14:1","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.16-mnwbfc-12","data.full-sync.index.1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d.1","bucket.sync-status.1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d:mnwbfc-7:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.11:1","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4939.2-mnwbfc-37","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","bucket.sync-status.1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d:mnwbfc-12:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.16:3","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.31-mnwbfc-27","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4739.4-mnwbfc-34","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","obj_delete_at_hint.0000000108","bucket.sync-status.1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d:mnwbfc-35:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4845.1:5","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","bucket.sync-status.1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d:mnwbfc-12:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.16:5","obj_delete_at_hint.0000000109","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4939.3-mnwbfc-38","obj_delete_at_hint.0000000013","bucket.sync-status.1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d:mnwbfc-11:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.15:5","obj_delete_at_hint.0000000051","2021-07-26-15-1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d.5037.2-mnwbfc-30","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","obj_delete_at_hint.0000000023","data.full-sync.index.1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d.2","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","meta.full-sync.index.2","bucket.sync-status.1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d:mnwbfc-7:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.11:3","data_log.2","obj_delete_at_hint.0000000067","obj_delete_at_hint.0000000086","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.32-mnwbfc-28","bucket.sync-status.1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d:mnwbfc-14:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.18:8","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.23-mnwbfc-19","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.24-mnwbfc-20","bucket.sync-status.1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d:mnwbfc-33:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4739.3:8","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.20-mnwbfc-16","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","datalog.sync-status.shard.1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d.0.retry","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4939.1-mnwbfc-36","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","obj_delete_at_hint.0000000097","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.3-mnwbfc-3","bucket.sync-status.1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d:mnwbfc-8:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.12:8","obj_delete_at_hint.0000000042","datalog.sync-status.shard.1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d.3.retry","bucket.sync-status.1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d:mnwbfc-7:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.11:8","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.27-mnwbfc-23","data.full-sync.index.1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d.3"] 2021-07-26T15:48:41.873 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['log', 'list', '--rgw-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:48:41.874 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'log', 'list', '--rgw-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:48:41.875 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 log list --rgw-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:48:41.914 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:48:41.915 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:48:42.124 INFO:teuthology.orchestra.run.smithi197.stdout:["obj_delete_at_hint.0000000078","meta.history","obj_delete_at_hint.0000000070","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.10-mnwbfc-6","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","bucket.sync-status.fdbd535a-3fb6-49cb-8b49-68faf14e40fe:mnwbfc-8:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.12:3","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.9-mnwbfc-5","obj_delete_at_hint.0000000040","meta.full-sync.index.0","bucket.sync-status.fdbd535a-3fb6-49cb-8b49-68faf14e40fe:mnwbfc-7:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.11:3","obj_delete_at_hint.0000000015","bucket.sync-status.fdbd535a-3fb6-49cb-8b49-68faf14e40fe:mnwbfc-10:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.14:1","obj_delete_at_hint.0000000069","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.11-mnwbfc-7","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4739.1-mnwbfc-31","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.22-mnwbfc-18","obj_delete_at_hint.0000000024","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.17-mnwbfc-13","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","data_log.3","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.4-mnwbfc-4","bucket.sync-status.fdbd535a-3fb6-49cb-8b49-68faf14e40fe:mnwbfc-12:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.16:1","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","bucket.sync-status.fdbd535a-3fb6-49cb-8b49-68faf14e40fe:mnwbfc-11:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.15:5","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","datalog.sync-status.shard.fdbd535a-3fb6-49cb-8b49-68faf14e40fe.1.retry","bucket.sync-status.fdbd535a-3fb6-49cb-8b49-68faf14e40fe:mnwbfc-18:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.22:8","bucket.sync-status.fdbd535a-3fb6-49cb-8b49-68faf14e40fe:mnwbfc-7:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.11:7","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.14-mnwbfc-10","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.18-mnwbfc-14","bucket.sync-status.fdbd535a-3fb6-49cb-8b49-68faf14e40fe:mnwbfc-33:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4739.3:8","obj_delete_at_hint.0000000088","meta.log.816a1f73-b2bd-4f0e-a507-b6c39ba8a110.2","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","obj_delete_at_hint.0000000096","data.full-sync.index.fdbd535a-3fb6-49cb-8b49-68faf14e40fe.1","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4939.6-mnwbfc-41","bucket.sync-status.fdbd535a-3fb6-49cb-8b49-68faf14e40fe:mnwbfc-12:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.16:5","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","bilog.trim","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","datalog.sync-status.shard.fdbd535a-3fb6-49cb-8b49-68faf14e40fe.1","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","obj_delete_at_hint.0000000014","bucket.sync-status.fdbd535a-3fb6-49cb-8b49-68faf14e40fe:mnwbfc-8:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.12:1","bucket.sync-status.fdbd535a-3fb6-49cb-8b49-68faf14e40fe:mnwbfc-14:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.18:8","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","bucket.sync-status.fdbd535a-3fb6-49cb-8b49-68faf14e40fe:mnwbfc-15:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.19:8","data.full-sync.index.fdbd535a-3fb6-49cb-8b49-68faf14e40fe.2","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4739.2-mnwbfc-32","data_log.1","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.30-mnwbfc-26","obj_delete_at_hint.0000000125","2021-07-26-15-1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d.5037.1-mnwbfc-29","obj_delete_at_hint.0000000082","meta.full-sync.index.1","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.28-mnwbfc-24","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.1-mnwbfc-1","bucket.sync-status.fdbd535a-3fb6-49cb-8b49-68faf14e40fe:mnwbfc-34:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4739.4:8","mdlog.sync-status.shard.2","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4939.4-mnwbfc-39","bucket.sync-status.fdbd535a-3fb6-49cb-8b49-68faf14e40fe:mnwbfc-8:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.12:7","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","bucket.sync-status.fdbd535a-3fb6-49cb-8b49-68faf14e40fe:mnwbfc-16:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.20:8","obj_delete_at_hint.0000000116","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.13-mnwbfc-9","obj_delete_at_hint.0000000034","datalog.sync-status.fdbd535a-3fb6-49cb-8b49-68faf14e40fe","obj_delete_at_hint.0000000101","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.12-mnwbfc-8","mdlog.sync-status.shard.1","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.19-mnwbfc-15","obj_delete_at_hint.0000000079","bucket.sync-status.fdbd535a-3fb6-49cb-8b49-68faf14e40fe:mnwbfc-9:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.13:1","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","data.full-sync.index.fdbd535a-3fb6-49cb-8b49-68faf14e40fe.3","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.26-mnwbfc-22","obj_delete_at_hint.0000000066","datalog.sync-status.shard.fdbd535a-3fb6-49cb-8b49-68faf14e40fe.0","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.15-mnwbfc-11","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4739.3-mnwbfc-33","obj_delete_at_hint.0000000068","bucket.sync-status.fdbd535a-3fb6-49cb-8b49-68faf14e40fe:mnwbfc-7:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.11:8","obj_delete_at_hint.0000000085","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","meta.full-sync.index.3","obj_delete_at_hint.0000000118","bucket.sync-status.fdbd535a-3fb6-49cb-8b49-68faf14e40fe:mnwbfc-13:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.17:5","bucket.sync-status.fdbd535a-3fb6-49cb-8b49-68faf14e40fe:mnwbfc-11:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.15:1","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.29-mnwbfc-25","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","mdlog.sync-status.shard.3","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","bucket.sync-status.fdbd535a-3fb6-49cb-8b49-68faf14e40fe:mnwbfc-25:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.29:10","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.2-mnwbfc-2","data.full-sync.index.fdbd535a-3fb6-49cb-8b49-68faf14e40fe.0","mdlog.sync-status.shard.0","obj_delete_at_hint.0000000027","mdlog.sync-status","obj_delete_at_hint.0000000019","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4845.1-mnwbfc-35","obj_delete_at_hint.0000000039","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.21-mnwbfc-17","bucket.sync-status.fdbd535a-3fb6-49cb-8b49-68faf14e40fe:mnwbfc-13:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.17:8","obj_delete_at_hint.0000000100","datalog.sync-status.shard.fdbd535a-3fb6-49cb-8b49-68faf14e40fe.0.retry","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","bucket.sync-status.fdbd535a-3fb6-49cb-8b49-68faf14e40fe:mnwbfc-17:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.21:8","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","data_log.0","obj_delete_at_hint.0000000012","bucket.sync-status.fdbd535a-3fb6-49cb-8b49-68faf14e40fe:mnwbfc-35:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4845.1:5","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.16-mnwbfc-12","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4939.2-mnwbfc-37","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.31-mnwbfc-27","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4739.4-mnwbfc-34","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","obj_delete_at_hint.0000000051","2021-07-26-15-1c1ee470-5f7c-4f9c-abb8-2ddbea5f263d.5037.2-mnwbfc-30","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","bucket.sync-status.fdbd535a-3fb6-49cb-8b49-68faf14e40fe:mnwbfc-12:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.16:3","obj_delete_at_hint.0000000023","datalog.sync-status.shard.fdbd535a-3fb6-49cb-8b49-68faf14e40fe.2.retry","obj_delete_at_hint.0000000107","datalog.sync-status.shard.fdbd535a-3fb6-49cb-8b49-68faf14e40fe.3","obj_delete_at_hint.0000000046","meta.full-sync.index.2","data_log.2","obj_delete_at_hint.0000000067","datalog.sync-status.shard.fdbd535a-3fb6-49cb-8b49-68faf14e40fe.2","obj_delete_at_hint.0000000086","bucket.sync-status.fdbd535a-3fb6-49cb-8b49-68faf14e40fe:mnwbfc-11:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.15:3","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.32-mnwbfc-28","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.24-mnwbfc-20","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.20-mnwbfc-16","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","bucket.sync-status.fdbd535a-3fb6-49cb-8b49-68faf14e40fe:mnwbfc-7:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.11:1","bucket.sync-status.fdbd535a-3fb6-49cb-8b49-68faf14e40fe:mnwbfc-8:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.12:8","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","bucket.sync-status.fdbd535a-3fb6-49cb-8b49-68faf14e40fe:mnwbfc-26:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.30:10","obj_delete_at_hint.0000000126","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","obj_delete_at_hint.0000000097","datalog.sync-status.shard.fdbd535a-3fb6-49cb-8b49-68faf14e40fe.3.retry","2021-07-26-15-fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.3-mnwbfc-3","obj_delete_at_hint.0000000042","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030"] 2021-07-26T15:48:42.152 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['log', 'list', '--rgw-zone', 'test-zone3', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:48:42.152 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'log', 'list', '--rgw-zone', 'test-zone3', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:48:42.153 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 log list --rgw-zone test-zone3 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:48:42.185 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:48:42.186 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:48:42.375 INFO:teuthology.orchestra.run.smithi197.stdout:["obj_delete_at_hint.0000000078","meta.history","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","bucket.sync-status.fdbd535a-3fb6-49cb-8b49-68faf14e40fe:mnwbfc-8:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.12:3","obj_delete_at_hint.0000000040","meta.full-sync.index.0","bucket.sync-status.fdbd535a-3fb6-49cb-8b49-68faf14e40fe:mnwbfc-7:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.11:3","obj_delete_at_hint.0000000015","bucket.sync-status.fdbd535a-3fb6-49cb-8b49-68faf14e40fe:mnwbfc-10:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.14:1","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","obj_delete_at_hint.0000000024","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","bucket.sync-status.fdbd535a-3fb6-49cb-8b49-68faf14e40fe:mnwbfc-12:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.16:1","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","bucket.sync-status.fdbd535a-3fb6-49cb-8b49-68faf14e40fe:mnwbfc-11:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.15:5","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","datalog.sync-status.shard.fdbd535a-3fb6-49cb-8b49-68faf14e40fe.1.retry","bucket.sync-status.fdbd535a-3fb6-49cb-8b49-68faf14e40fe:mnwbfc-18:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.22:8","bucket.sync-status.fdbd535a-3fb6-49cb-8b49-68faf14e40fe:mnwbfc-7:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.11:7","bucket.sync-status.fdbd535a-3fb6-49cb-8b49-68faf14e40fe:mnwbfc-33:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4739.3:8","obj_delete_at_hint.0000000088","meta.log.816a1f73-b2bd-4f0e-a507-b6c39ba8a110.2","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","obj_delete_at_hint.0000000096","data.full-sync.index.fdbd535a-3fb6-49cb-8b49-68faf14e40fe.1","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","bucket.sync-status.fdbd535a-3fb6-49cb-8b49-68faf14e40fe:mnwbfc-12:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.16:5","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","bilog.trim","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","datalog.sync-status.shard.fdbd535a-3fb6-49cb-8b49-68faf14e40fe.1","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","obj_delete_at_hint.0000000014","bucket.sync-status.fdbd535a-3fb6-49cb-8b49-68faf14e40fe:mnwbfc-8:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.12:1","bucket.sync-status.fdbd535a-3fb6-49cb-8b49-68faf14e40fe:mnwbfc-14:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.18:8","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","bucket.sync-status.fdbd535a-3fb6-49cb-8b49-68faf14e40fe:mnwbfc-15:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.19:8","data.full-sync.index.fdbd535a-3fb6-49cb-8b49-68faf14e40fe.2","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","meta.full-sync.index.1","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","meta.log.973db1f6-3ec7-4bde-a829-51b8cda6e0ef.0","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","meta.log.973db1f6-3ec7-4bde-a829-51b8cda6e0ef.3","bucket.sync-status.fdbd535a-3fb6-49cb-8b49-68faf14e40fe:mnwbfc-34:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4739.4:8","mdlog.sync-status.shard.2","bucket.sync-status.fdbd535a-3fb6-49cb-8b49-68faf14e40fe:mnwbfc-8:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.12:7","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","bucket.sync-status.fdbd535a-3fb6-49cb-8b49-68faf14e40fe:mnwbfc-16:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.20:8","obj_delete_at_hint.0000000116","obj_delete_at_hint.0000000034","datalog.sync-status.fdbd535a-3fb6-49cb-8b49-68faf14e40fe","obj_delete_at_hint.0000000101","mdlog.sync-status.shard.1","obj_delete_at_hint.0000000079","bucket.sync-status.fdbd535a-3fb6-49cb-8b49-68faf14e40fe:mnwbfc-9:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.13:1","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","data.full-sync.index.fdbd535a-3fb6-49cb-8b49-68faf14e40fe.3","obj_delete_at_hint.0000000066","datalog.sync-status.shard.fdbd535a-3fb6-49cb-8b49-68faf14e40fe.0","obj_delete_at_hint.0000000068","bucket.sync-status.fdbd535a-3fb6-49cb-8b49-68faf14e40fe:mnwbfc-7:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.11:8","obj_delete_at_hint.0000000085","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","meta.log.32f6ee58-702f-42e6-a264-989c7d3e6f45.2","meta.full-sync.index.3","obj_delete_at_hint.0000000118","bucket.sync-status.fdbd535a-3fb6-49cb-8b49-68faf14e40fe:mnwbfc-13:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.17:5","bucket.sync-status.fdbd535a-3fb6-49cb-8b49-68faf14e40fe:mnwbfc-11:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.15:1","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","mdlog.sync-status.shard.3","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","bucket.sync-status.fdbd535a-3fb6-49cb-8b49-68faf14e40fe:mnwbfc-25:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.29:10","data.full-sync.index.fdbd535a-3fb6-49cb-8b49-68faf14e40fe.0","mdlog.sync-status.shard.0","obj_delete_at_hint.0000000027","mdlog.sync-status","obj_delete_at_hint.0000000019","obj_delete_at_hint.0000000039","bucket.sync-status.fdbd535a-3fb6-49cb-8b49-68faf14e40fe:mnwbfc-13:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.17:8","obj_delete_at_hint.0000000100","datalog.sync-status.shard.fdbd535a-3fb6-49cb-8b49-68faf14e40fe.0.retry","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","bucket.sync-status.fdbd535a-3fb6-49cb-8b49-68faf14e40fe:mnwbfc-17:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.21:8","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","obj_delete_at_hint.0000000012","bucket.sync-status.fdbd535a-3fb6-49cb-8b49-68faf14e40fe:mnwbfc-35:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4845.1:5","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","obj_delete_at_hint.0000000051","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","bucket.sync-status.fdbd535a-3fb6-49cb-8b49-68faf14e40fe:mnwbfc-12:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.16:3","obj_delete_at_hint.0000000023","datalog.sync-status.shard.fdbd535a-3fb6-49cb-8b49-68faf14e40fe.2.retry","obj_delete_at_hint.0000000107","datalog.sync-status.shard.fdbd535a-3fb6-49cb-8b49-68faf14e40fe.3","obj_delete_at_hint.0000000046","meta.full-sync.index.2","obj_delete_at_hint.0000000067","datalog.sync-status.shard.fdbd535a-3fb6-49cb-8b49-68faf14e40fe.2","obj_delete_at_hint.0000000086","bucket.sync-status.fdbd535a-3fb6-49cb-8b49-68faf14e40fe:mnwbfc-11:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.15:3","meta.log.973db1f6-3ec7-4bde-a829-51b8cda6e0ef.2","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","bucket.sync-status.fdbd535a-3fb6-49cb-8b49-68faf14e40fe:mnwbfc-7:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.11:1","bucket.sync-status.fdbd535a-3fb6-49cb-8b49-68faf14e40fe:mnwbfc-8:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.12:8","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","bucket.sync-status.fdbd535a-3fb6-49cb-8b49-68faf14e40fe:mnwbfc-26:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4275.30:10","obj_delete_at_hint.0000000126","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","obj_delete_at_hint.0000000097","datalog.sync-status.shard.fdbd535a-3fb6-49cb-8b49-68faf14e40fe.3.retry","obj_delete_at_hint.0000000042","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030"] 2021-07-26T15:48:42.401 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:48:42.402 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:48:42.403 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:48:42.442 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:48:42.443 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:48:42.635 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"1_1627314521.525702_247.2","last_update":"2021-07-26T15:48:41.525702Z"},{"marker":"1_1627314521.525702_350.3","last_update":"2021-07-26T15:48:41.525702Z"},{"marker":"1_1627314521.525702_188.3","last_update":"2021-07-26T15:48:41.525702Z"},{"marker":"1_1627314521.525702_460.3","last_update":"2021-07-26T15:48:41.525702Z"}] 2021-07-26T15:48:42.636 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2021-07-26T15:48:42.636 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:48:42.637 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:48:42.637 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:48:42.682 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:48:42.682 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:48:42.876 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":18132629931907925738},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314031.129942_132.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:31.129942Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314198.628187_206.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:43:18.628187Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314388.086736_149.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:46:28.086736Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314061.532733_328.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:41:01.532733Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T15:48:42.877 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=1_1627314521.525702_247.2 target=1_1627314031.129942_132.2, shard=1 master=1_1627314521.525702_350.3 target=1_1627314198.628187_206.1, shard=2 master=1_1627314521.525702_188.3 target=1_1627314388.086736_149.1, shard=3 master=1_1627314521.525702_460.3 target=1_1627314061.532733_328.1 2021-07-26T15:48:47.879 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:48:47.879 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:48:47.880 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:48:47.918 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:48:47.918 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:48:48.111 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":18132629931907925738},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314031.129942_132.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:31.129942Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314198.628187_206.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:43:18.628187Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314388.086736_149.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:46:28.086736Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314061.532733_328.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:41:01.532733Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T15:48:48.112 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=1_1627314521.525702_247.2 target=1_1627314031.129942_132.2, shard=1 master=1_1627314521.525702_350.3 target=1_1627314198.628187_206.1, shard=2 master=1_1627314521.525702_188.3 target=1_1627314388.086736_149.1, shard=3 master=1_1627314521.525702_460.3 target=1_1627314061.532733_328.1 2021-07-26T15:48:53.113 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:48:53.114 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:48:53.115 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:48:53.157 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:48:53.157 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:48:53.367 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":18132629931907925738},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314031.129942_132.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:31.129942Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314198.628187_206.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:43:18.628187Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314388.086736_149.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:46:28.086736Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314061.532733_328.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:41:01.532733Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T15:48:53.368 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=1_1627314521.525702_247.2 target=1_1627314031.129942_132.2, shard=1 master=1_1627314521.525702_350.3 target=1_1627314198.628187_206.1, shard=2 master=1_1627314521.525702_188.3 target=1_1627314388.086736_149.1, shard=3 master=1_1627314521.525702_460.3 target=1_1627314061.532733_328.1 2021-07-26T15:48:58.369 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:48:58.370 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:48:58.371 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:48:58.412 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:48:58.413 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:48:58.623 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":18132629931907925738},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314031.129942_132.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:31.129942Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314198.628187_206.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:43:18.628187Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314388.086736_149.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:46:28.086736Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314061.532733_328.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:41:01.532733Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T15:48:58.623 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=1_1627314521.525702_247.2 target=1_1627314031.129942_132.2, shard=1 master=1_1627314521.525702_350.3 target=1_1627314198.628187_206.1, shard=2 master=1_1627314521.525702_188.3 target=1_1627314388.086736_149.1, shard=3 master=1_1627314521.525702_460.3 target=1_1627314061.532733_328.1 2021-07-26T15:49:03.625 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:03.627 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:03.627 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:49:03.670 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:49:03.671 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:49:03.875 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":18132629931907925738},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314031.129942_132.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:31.129942Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314198.628187_206.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:43:18.628187Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314388.086736_149.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:46:28.086736Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314061.532733_328.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:41:01.532733Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T15:49:03.876 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=1_1627314521.525702_247.2 target=1_1627314031.129942_132.2, shard=1 master=1_1627314521.525702_350.3 target=1_1627314198.628187_206.1, shard=2 master=1_1627314521.525702_188.3 target=1_1627314388.086736_149.1, shard=3 master=1_1627314521.525702_460.3 target=1_1627314061.532733_328.1 2021-07-26T15:49:08.877 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:08.878 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:08.878 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:49:08.919 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:49:08.920 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:49:09.131 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":18132629931907925738},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314031.129942_132.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:31.129942Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314198.628187_206.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:43:18.628187Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314388.086736_149.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:46:28.086736Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314061.532733_328.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:41:01.532733Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T15:49:09.132 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=1_1627314521.525702_247.2 target=1_1627314031.129942_132.2, shard=1 master=1_1627314521.525702_350.3 target=1_1627314198.628187_206.1, shard=2 master=1_1627314521.525702_188.3 target=1_1627314388.086736_149.1, shard=3 master=1_1627314521.525702_460.3 target=1_1627314061.532733_328.1 2021-07-26T15:49:14.133 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:14.134 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:14.135 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:49:14.176 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:49:14.177 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:49:14.390 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":18132629931907925738},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314031.129942_132.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:31.129942Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314198.628187_206.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:43:18.628187Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314388.086736_149.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:46:28.086736Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314061.532733_328.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:41:01.532733Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T15:49:14.391 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=1_1627314521.525702_247.2 target=1_1627314031.129942_132.2, shard=1 master=1_1627314521.525702_350.3 target=1_1627314198.628187_206.1, shard=2 master=1_1627314521.525702_188.3 target=1_1627314388.086736_149.1, shard=3 master=1_1627314521.525702_460.3 target=1_1627314061.532733_328.1 2021-07-26T15:49:19.392 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:19.394 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:19.394 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:49:19.436 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:49:19.437 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:49:19.637 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":18132629931907925738},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314031.129942_132.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:31.129942Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314198.628187_206.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:43:18.628187Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314388.086736_149.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:46:28.086736Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314061.532733_328.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:41:01.532733Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T15:49:19.637 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=1_1627314521.525702_247.2 target=1_1627314031.129942_132.2, shard=1 master=1_1627314521.525702_350.3 target=1_1627314198.628187_206.1, shard=2 master=1_1627314521.525702_188.3 target=1_1627314388.086736_149.1, shard=3 master=1_1627314521.525702_460.3 target=1_1627314061.532733_328.1 2021-07-26T15:49:24.639 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:24.639 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:24.640 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:49:24.681 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:49:24.682 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:49:24.883 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":18132629931907925738},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314031.129942_132.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:31.129942Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314198.628187_206.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:43:18.628187Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314388.086736_149.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:46:28.086736Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314061.532733_328.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:41:01.532733Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T15:49:24.884 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=1_1627314521.525702_247.2 target=1_1627314031.129942_132.2, shard=1 master=1_1627314521.525702_350.3 target=1_1627314198.628187_206.1, shard=2 master=1_1627314521.525702_188.3 target=1_1627314388.086736_149.1, shard=3 master=1_1627314521.525702_460.3 target=1_1627314061.532733_328.1 2021-07-26T15:49:29.886 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:29.887 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:29.887 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:49:29.929 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:49:29.929 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:49:30.129 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":18132629931907925738},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314031.129942_132.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:31.129942Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314198.628187_206.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:43:18.628187Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314388.086736_149.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:46:28.086736Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314061.532733_328.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:41:01.532733Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T15:49:30.130 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=1_1627314521.525702_247.2 target=1_1627314031.129942_132.2, shard=1 master=1_1627314521.525702_350.3 target=1_1627314198.628187_206.1, shard=2 master=1_1627314521.525702_188.3 target=1_1627314388.086736_149.1, shard=3 master=1_1627314521.525702_460.3 target=1_1627314061.532733_328.1 2021-07-26T15:49:35.131 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:35.131 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:35.132 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:49:35.174 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:49:35.174 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:49:35.382 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":18132629931907925738},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314031.129942_132.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:31.129942Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314198.628187_206.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:43:18.628187Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314388.086736_149.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:46:28.086736Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314061.532733_328.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:41:01.532733Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T15:49:35.383 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=1_1627314521.525702_247.2 target=1_1627314031.129942_132.2, shard=1 master=1_1627314521.525702_350.3 target=1_1627314198.628187_206.1, shard=2 master=1_1627314521.525702_188.3 target=1_1627314388.086736_149.1, shard=3 master=1_1627314521.525702_460.3 target=1_1627314061.532733_328.1 2021-07-26T15:49:40.384 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:40.385 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:40.385 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:49:40.428 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:49:40.428 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:49:40.647 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":18132629931907925738},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314031.129942_132.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:31.129942Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314198.628187_206.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:43:18.628187Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314388.086736_149.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:46:28.086736Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314061.532733_328.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:41:01.532733Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T15:49:40.648 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=1_1627314521.525702_247.2 target=1_1627314031.129942_132.2, shard=1 master=1_1627314521.525702_350.3 target=1_1627314198.628187_206.1, shard=2 master=1_1627314521.525702_188.3 target=1_1627314388.086736_149.1, shard=3 master=1_1627314521.525702_460.3 target=1_1627314061.532733_328.1 2021-07-26T15:49:45.649 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:45.651 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:45.651 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:49:45.693 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:49:45.694 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:49:45.902 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":18132629931907925738},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314521.525702_247.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:48:41.525702Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314521.525702_350.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:48:41.525702Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314521.525702_188.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:48:41.525702Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314521.525702_460.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:48:41.525702Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T15:49:45.903 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2021-07-26T15:49:45.904 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:45.904 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:45.905 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:49:45.944 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:49:45.944 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:49:46.150 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"1_1627314521.525702_247.2","last_update":"2021-07-26T15:48:41.525702Z"},{"marker":"1_1627314521.525702_350.3","last_update":"2021-07-26T15:48:41.525702Z"},{"marker":"1_1627314521.525702_188.3","last_update":"2021-07-26T15:48:41.525702Z"},{"marker":"1_1627314521.525702_460.3","last_update":"2021-07-26T15:48:41.525702Z"}] 2021-07-26T15:49:46.150 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone3 source_zone=test-zone1 2021-07-26T15:49:46.151 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:46.151 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:46.152 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:49:46.193 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:49:46.194 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:49:46.390 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":3487142670906618468},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314031.129942_132.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:31.129942Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314198.628187_206.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:43:18.628187Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314388.086736_149.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:46:28.086736Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314061.532733_328.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:41:01.532733Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T15:49:46.391 WARNING:rgw_multi.tests:data of zone test-zone3 behind zone test-zone1: shard=0 master=1_1627314521.525702_247.2 target=1_1627314031.129942_132.2, shard=1 master=1_1627314521.525702_350.3 target=1_1627314198.628187_206.1, shard=2 master=1_1627314521.525702_188.3 target=1_1627314388.086736_149.1, shard=3 master=1_1627314521.525702_460.3 target=1_1627314061.532733_328.1 2021-07-26T15:49:51.392 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:51.393 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:51.394 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:49:51.437 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:49:51.438 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:49:51.631 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":3487142670906618468},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314031.129942_132.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:31.129942Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314198.628187_206.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:43:18.628187Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314388.086736_149.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:46:28.086736Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314061.532733_328.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:41:01.532733Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T15:49:51.632 WARNING:rgw_multi.tests:data of zone test-zone3 behind zone test-zone1: shard=0 master=1_1627314521.525702_247.2 target=1_1627314031.129942_132.2, shard=1 master=1_1627314521.525702_350.3 target=1_1627314198.628187_206.1, shard=2 master=1_1627314521.525702_188.3 target=1_1627314388.086736_149.1, shard=3 master=1_1627314521.525702_460.3 target=1_1627314061.532733_328.1 2021-07-26T15:49:56.633 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:56.634 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:56.635 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:49:56.678 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:49:56.678 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:49:56.875 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":3487142670906618468},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314031.129942_132.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:31.129942Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314198.628187_206.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:43:18.628187Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314388.086736_149.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:46:28.086736Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314061.532733_328.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:41:01.532733Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T15:49:56.876 WARNING:rgw_multi.tests:data of zone test-zone3 behind zone test-zone1: shard=0 master=1_1627314521.525702_247.2 target=1_1627314031.129942_132.2, shard=1 master=1_1627314521.525702_350.3 target=1_1627314198.628187_206.1, shard=2 master=1_1627314521.525702_188.3 target=1_1627314388.086736_149.1, shard=3 master=1_1627314521.525702_460.3 target=1_1627314061.532733_328.1 2021-07-26T15:50:01.878 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:01.879 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:01.880 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:01.922 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:01.923 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:02.130 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":3487142670906618468},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314031.129942_132.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:31.129942Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314198.628187_206.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:43:18.628187Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314388.086736_149.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:46:28.086736Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314061.532733_328.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:41:01.532733Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T15:50:02.130 WARNING:rgw_multi.tests:data of zone test-zone3 behind zone test-zone1: shard=0 master=1_1627314521.525702_247.2 target=1_1627314031.129942_132.2, shard=1 master=1_1627314521.525702_350.3 target=1_1627314198.628187_206.1, shard=2 master=1_1627314521.525702_188.3 target=1_1627314388.086736_149.1, shard=3 master=1_1627314521.525702_460.3 target=1_1627314061.532733_328.1 2021-07-26T15:50:07.133 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:07.134 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:07.135 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:07.178 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:07.179 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:07.386 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":3487142670906618468},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314031.129942_132.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:31.129942Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314198.628187_206.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:43:18.628187Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314388.086736_149.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:46:28.086736Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314061.532733_328.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:41:01.532733Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T15:50:07.386 WARNING:rgw_multi.tests:data of zone test-zone3 behind zone test-zone1: shard=0 master=1_1627314521.525702_247.2 target=1_1627314031.129942_132.2, shard=1 master=1_1627314521.525702_350.3 target=1_1627314198.628187_206.1, shard=2 master=1_1627314521.525702_188.3 target=1_1627314388.086736_149.1, shard=3 master=1_1627314521.525702_460.3 target=1_1627314061.532733_328.1 2021-07-26T15:50:12.387 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:12.388 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:12.389 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:12.431 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:12.431 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:12.631 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":3487142670906618468},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314031.129942_132.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:31.129942Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314198.628187_206.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:43:18.628187Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314388.086736_149.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:46:28.086736Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314061.532733_328.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:41:01.532733Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T15:50:12.632 WARNING:rgw_multi.tests:data of zone test-zone3 behind zone test-zone1: shard=0 master=1_1627314521.525702_247.2 target=1_1627314031.129942_132.2, shard=1 master=1_1627314521.525702_350.3 target=1_1627314198.628187_206.1, shard=2 master=1_1627314521.525702_188.3 target=1_1627314388.086736_149.1, shard=3 master=1_1627314521.525702_460.3 target=1_1627314061.532733_328.1 2021-07-26T15:50:17.634 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:17.635 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:17.635 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:17.676 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:17.677 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:17.860 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":3487142670906618468},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314031.129942_132.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:31.129942Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314198.628187_206.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:43:18.628187Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314388.086736_149.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:46:28.086736Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314061.532733_328.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:41:01.532733Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T15:50:17.860 WARNING:rgw_multi.tests:data of zone test-zone3 behind zone test-zone1: shard=0 master=1_1627314521.525702_247.2 target=1_1627314031.129942_132.2, shard=1 master=1_1627314521.525702_350.3 target=1_1627314198.628187_206.1, shard=2 master=1_1627314521.525702_188.3 target=1_1627314388.086736_149.1, shard=3 master=1_1627314521.525702_460.3 target=1_1627314061.532733_328.1 2021-07-26T15:50:22.862 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:22.862 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:22.863 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:22.904 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:22.905 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:23.110 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":3487142670906618468},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314031.129942_132.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:31.129942Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314198.628187_206.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:43:18.628187Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314388.086736_149.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:46:28.086736Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314061.532733_328.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:41:01.532733Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T15:50:23.111 WARNING:rgw_multi.tests:data of zone test-zone3 behind zone test-zone1: shard=0 master=1_1627314521.525702_247.2 target=1_1627314031.129942_132.2, shard=1 master=1_1627314521.525702_350.3 target=1_1627314198.628187_206.1, shard=2 master=1_1627314521.525702_188.3 target=1_1627314388.086736_149.1, shard=3 master=1_1627314521.525702_460.3 target=1_1627314061.532733_328.1 2021-07-26T15:50:28.112 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:28.112 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:28.113 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:28.161 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:28.161 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:28.370 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":3487142670906618468},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314031.129942_132.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:31.129942Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314198.628187_206.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:43:18.628187Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314388.086736_149.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:46:28.086736Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314061.532733_328.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:41:01.532733Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T15:50:28.370 WARNING:rgw_multi.tests:data of zone test-zone3 behind zone test-zone1: shard=0 master=1_1627314521.525702_247.2 target=1_1627314031.129942_132.2, shard=1 master=1_1627314521.525702_350.3 target=1_1627314198.628187_206.1, shard=2 master=1_1627314521.525702_188.3 target=1_1627314388.086736_149.1, shard=3 master=1_1627314521.525702_460.3 target=1_1627314061.532733_328.1 2021-07-26T15:50:33.371 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:33.372 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:33.373 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:33.413 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:33.414 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:33.620 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":3487142670906618468},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314031.129942_132.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:31.129942Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314198.628187_206.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:43:18.628187Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314388.086736_149.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:46:28.086736Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314061.532733_328.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:41:01.532733Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T15:50:33.621 WARNING:rgw_multi.tests:data of zone test-zone3 behind zone test-zone1: shard=0 master=1_1627314521.525702_247.2 target=1_1627314031.129942_132.2, shard=1 master=1_1627314521.525702_350.3 target=1_1627314198.628187_206.1, shard=2 master=1_1627314521.525702_188.3 target=1_1627314388.086736_149.1, shard=3 master=1_1627314521.525702_460.3 target=1_1627314061.532733_328.1 2021-07-26T15:50:38.623 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:38.624 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:38.625 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:38.667 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:38.668 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:38.868 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":3487142670906618468},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314031.129942_132.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:31.129942Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314198.628187_206.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:43:18.628187Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314388.086736_149.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:46:28.086736Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314061.532733_328.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:41:01.532733Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T15:50:38.869 WARNING:rgw_multi.tests:data of zone test-zone3 behind zone test-zone1: shard=0 master=1_1627314521.525702_247.2 target=1_1627314031.129942_132.2, shard=1 master=1_1627314521.525702_350.3 target=1_1627314198.628187_206.1, shard=2 master=1_1627314521.525702_188.3 target=1_1627314388.086736_149.1, shard=3 master=1_1627314521.525702_460.3 target=1_1627314061.532733_328.1 2021-07-26T15:50:40.810 INFO:tasks.rgw.c2.client.1.smithi197.stdout:2021-07-26T15:50:40.801+0000 7f43faffd700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:50:40.811 INFO:tasks.rgw.c2.client.1.smithi197.stdout:2021-07-26T15:50:40.801+0000 7f43f5ff3700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:50:40.811 INFO:tasks.rgw.c2.client.1.smithi197.stdout:2021-07-26T15:50:40.801+0000 7f43f5ff3700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:50:40.812 INFO:tasks.rgw.c2.client.1.smithi197.stdout:2021-07-26T15:50:40.805+0000 7f44037fe700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:50:40.812 INFO:tasks.rgw.c2.client.1.smithi197.stdout:2021-07-26T15:50:40.805+0000 7f43f6ff5700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:50:40.812 INFO:tasks.rgw.c2.client.1.smithi197.stdout:2021-07-26T15:50:40.805+0000 7f43faffd700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:50:40.812 INFO:tasks.rgw.c2.client.1.smithi197.stdout:2021-07-26T15:50:40.805+0000 7f440effd700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:50:40.813 INFO:tasks.rgw.c2.client.1.smithi197.stdout:2021-07-26T15:50:40.805+0000 7f43f67f4700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:50:40.813 INFO:tasks.rgw.c2.client.1.smithi197.stdout:2021-07-26T15:50:40.805+0000 7f43f6ff5700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:50:40.813 INFO:tasks.rgw.c2.client.1.smithi197.stdout:2021-07-26T15:50:40.805+0000 7f44037fe700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:50:40.818 INFO:tasks.rgw.c2.client.1.smithi197.stdout:2021-07-26T15:50:40.813+0000 7f4403fff700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:50:40.819 INFO:tasks.rgw.c2.client.1.smithi197.stdout:2021-07-26T15:50:40.813+0000 7f43f77f6700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:50:40.819 INFO:tasks.rgw.c2.client.1.smithi197.stdout:2021-07-26T15:50:40.813+0000 7f43f8ff9700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:50:43.870 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:43.871 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:43.871 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:43.914 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:43.914 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:44.115 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":3487142670906618468},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314521.525702_247.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:48:41.525702Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314521.525702_350.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:48:41.525702Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314521.525702_188.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:48:41.525702Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314521.525702_460.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:48:41.525702Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T15:50:44.115 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone3 source_zone=test-zone1 2021-07-26T15:50:44.116 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:44.116 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:44.117 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:44.155 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:44.155 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:44.353 INFO:teuthology.orchestra.run.smithi197.stdout:[{"marker":"1_1627314563.561190_210.2","last_update":"2021-07-26T15:49:23.561190Z"},{"marker":"1_1627314563.561190_370.3","last_update":"2021-07-26T15:49:23.561190Z"},{"marker":"1_1627314563.561190_251.3","last_update":"2021-07-26T15:49:23.561190Z"},{"marker":"1_1627314563.561190_473.3","last_update":"2021-07-26T15:49:23.561190Z"}] 2021-07-26T15:50:44.354 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2021-07-26T15:50:44.355 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:44.355 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:44.356 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:44.396 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:44.396 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:44.588 INFO:teuthology.orchestra.run.smithi183.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":8875080199853872167},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314563.561190_210.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:49:23.561190Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314563.561190_370.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:49:23.561190Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314563.561190_251.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:49:23.561190Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314563.561190_473.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:49:23.561190Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T15:50:44.589 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2021-07-26T15:50:44.590 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_sync_disable ... ok 2021-07-26T15:50:44.591 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=mnwbfc-42 2021-07-26T15:50:44.624 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=mnwbfc-43 2021-07-26T15:50:45.071 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-42', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:45.072 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-42', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:45.072 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-42 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:45.113 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:45.113 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:45.277 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":"00000000001.58.5"},{"key":1,"val":""},{"key":2,"val":"00000000001.31.5"},{"key":3,"val":""},{"key":4,"val":"00000000001.32.5"},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000001.22.5"},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:50:45.278 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=mnwbfc-42 2021-07-26T15:50:45.278 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:45.279 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:45.280 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-42 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:45.322 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:45.322 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:45.527 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj3","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.58.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj2","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.31.5"}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj1","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.32.5"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.22.5"}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:50:45.528 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=mnwbfc-42 2021-07-26T15:50:45.528 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-42', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:45.529 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-42', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:45.530 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-42 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:45.574 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:45.574 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:45.779 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":"00000000001.58.5"},{"key":1,"val":""},{"key":2,"val":"00000000001.31.5"},{"key":3,"val":""},{"key":4,"val":"00000000001.32.5"},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000001.22.5"},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:50:45.780 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-42 2021-07-26T15:50:45.780 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:45.781 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:45.781 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-42 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:45.821 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:45.821 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:46.008 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.58.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.31.5"}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.32.5"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.22.5"}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:50:46.009 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-42 2021-07-26T15:50:46.010 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:46.011 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:46.011 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-42 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:46.092 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:46.093 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:46.298 INFO:teuthology.orchestra.run.smithi197.stdout:{"markers":[{"key":0,"val":"00000000001.51.5"},{"key":1,"val":""},{"key":2,"val":"00000000001.36.5"},{"key":3,"val":""},{"key":4,"val":"00000000001.31.5"},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000001.21.5"},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:50:46.568 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=mnwbfc-42 2021-07-26T15:50:46.569 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'mnwbfc-42', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:46.569 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'mnwbfc-42', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:46.570 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket mnwbfc-42 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:46.612 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:46.613 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:46.825 INFO:teuthology.orchestra.run.smithi183.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj3","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.51.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj2","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.36.5"}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj1","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.31.5"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.21.5"}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:50:46.826 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=mnwbfc-42 2021-07-26T15:50:46.827 INFO:tasks.rgw_multi.zone_rados:comparing bucket=mnwbfc-42 zones={test-zone2, test-zone1} 2021-07-26T15:50:46.835 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:50:46.887 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-07-26T15:50:46.888 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-07-26T15:50:46.888 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-07-26T15:50:46.889 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-07-26T15:50:46.889 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:50:46.896 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-07-26T15:50:46.896 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-07-26T15:50:46.896 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-07-26T15:50:46.897 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-07-26T15:50:46.947 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-07-26T15:50:47.001 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-07-26T15:50:47.109 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-07-26T15:50:47.213 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-07-26T15:50:47.271 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-07-26T15:50:47.377 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-07-26T15:50:47.484 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-07-26T15:50:47.540 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-07-26T15:50:47.649 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-07-26T15:50:47.748 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-07-26T15:50:47.807 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-07-26T15:50:47.911 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-07-26T15:50:48.017 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=mnwbfc-42 zones={test-zone2, test-zone1} 2021-07-26T15:50:48.017 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-43', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:48.018 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-43', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:48.018 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-43 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:48.057 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:48.058 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:48.251 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":"00000000001.31.5"},{"key":1,"val":""},{"key":2,"val":"00000000001.38.5"},{"key":3,"val":""},{"key":4,"val":"00000000001.43.5"},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000001.45.5"},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:50:48.251 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=mnwbfc-43 2021-07-26T15:50:48.252 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-43', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:48.252 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-43', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:48.253 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-43 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:48.296 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:48.297 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:48.511 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj3","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.31.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj2","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.38.5"}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj1","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.43.5"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.45.5"}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:50:48.512 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=mnwbfc-43 2021-07-26T15:50:48.512 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-43', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:48.513 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-43', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:48.513 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-43 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:48.551 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:48.551 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:48.749 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":"00000000001.31.5"},{"key":1,"val":""},{"key":2,"val":"00000000001.38.5"},{"key":3,"val":""},{"key":4,"val":"00000000001.43.5"},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000001.45.5"},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:50:48.749 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-43 2021-07-26T15:50:48.750 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-43', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:48.751 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-43', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:48.751 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-43 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:48.793 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:48.793 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:48.988 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.31.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.38.5"}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.43.5"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.45.5"}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:50:48.988 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-43 2021-07-26T15:50:48.989 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-43', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:48.989 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-43', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:48.990 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-43 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:49.068 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:49.068 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:49.260 INFO:teuthology.orchestra.run.smithi197.stdout:{"markers":[{"key":0,"val":"00000000001.56.5"},{"key":1,"val":""},{"key":2,"val":"00000000001.42.5"},{"key":3,"val":""},{"key":4,"val":"00000000001.41.5"},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000001.45.5"},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:50:49.260 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=mnwbfc-43 2021-07-26T15:50:49.261 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'mnwbfc-43', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:49.262 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'mnwbfc-43', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:49.262 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket mnwbfc-43 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:49.307 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:49.308 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:49.515 INFO:teuthology.orchestra.run.smithi183.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj3","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.56.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj2","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.42.5"}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj1","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.41.5"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.45.5"}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:50:49.516 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=mnwbfc-43 2021-07-26T15:50:49.516 INFO:tasks.rgw_multi.zone_rados:comparing bucket=mnwbfc-43 zones={test-zone2, test-zone1} 2021-07-26T15:50:49.525 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:50:49.532 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-07-26T15:50:49.532 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-07-26T15:50:49.533 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-07-26T15:50:49.533 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-07-26T15:50:49.534 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:50:49.540 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-07-26T15:50:49.540 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-07-26T15:50:49.541 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-07-26T15:50:49.541 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-07-26T15:50:49.593 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-07-26T15:50:49.647 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-07-26T15:50:49.754 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-07-26T15:50:49.852 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-07-26T15:50:49.908 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-07-26T15:50:50.011 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-07-26T15:50:50.111 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-07-26T15:50:50.166 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-07-26T15:50:50.274 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-07-26T15:50:50.376 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-07-26T15:50:50.432 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-07-26T15:50:50.537 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-07-26T15:50:50.637 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=mnwbfc-43 zones={test-zone2, test-zone1} 2021-07-26T15:50:50.638 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'disable', '--bucket', 'mnwbfc-42', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:50:50.638 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'disable', '--bucket', 'mnwbfc-42', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:50:50.639 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync disable --bucket mnwbfc-42 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:50:50.677 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:50.678 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:50.914 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'enable', '--bucket', 'mnwbfc-42', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:50:50.915 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'enable', '--bucket', 'mnwbfc-42', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:50:50.915 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync enable --bucket mnwbfc-42 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:50:50.996 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:50.996 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:51.220 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'disable', '--bucket', 'mnwbfc-43', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:50:51.221 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'disable', '--bucket', 'mnwbfc-43', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:50:51.222 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync disable --bucket mnwbfc-43 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:50:51.261 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:51.261 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:51.500 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'enable', '--bucket', 'mnwbfc-43', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:50:51.500 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'enable', '--bucket', 'mnwbfc-43', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:50:51.501 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync enable --bucket mnwbfc-43 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:50:51.583 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:51.584 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:52.231 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-42', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:52.232 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-42', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:52.232 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-42 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:52.273 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:52.273 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:52.472 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":"00000000006.72.5"},{"key":1,"val":"00000000004.45.1"},{"key":2,"val":"00000000006.37.5"},{"key":3,"val":"00000000004.36.1"},{"key":4,"val":"00000000006.42.5"},{"key":5,"val":"00000000004.37.1"},{"key":6,"val":"00000000004.118.1"},{"key":7,"val":"00000000006.28.5"},{"key":8,"val":"00000000004.42.1"},{"key":9,"val":"00000000004.34.1"},{"key":10,"val":"00000000004.66.1"}]} 2021-07-26T15:50:52.473 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=mnwbfc-42 2021-07-26T15:50:52.474 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:52.474 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:52.476 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-42 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:52.520 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:52.520 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:52.728 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj7","instance":"","ns":""},"count":3},"inc_marker":{"position":"00000000006.72.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj6","instance":"","ns":""},"count":3},"inc_marker":{"position":"00000000006.37.5"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.36.1"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj5","instance":"","ns":""},"count":3},"inc_marker":{"position":"00000000006.42.5"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.118.1"}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj8","instance":"","ns":""},"count":3},"inc_marker":{"position":"00000000006.28.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.42.1"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.66.1"}}}] 2021-07-26T15:50:52.729 WARNING:rgw_multi.tests:bucket mnwbfc-42 zone test-zone2 behind zone test-zone1: shard=1 master=00000000004.45.1 target=, shard=5 master=00000000004.37.1 target=, shard=9 master=00000000004.34.1 target= 2021-07-26T15:50:57.731 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:57.731 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:57.732 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-42 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:57.777 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:57.777 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:57.976 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj7","instance":"","ns":""},"count":3},"inc_marker":{"position":"00000000006.72.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj6","instance":"","ns":""},"count":3},"inc_marker":{"position":"00000000006.37.5"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.36.1"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj5","instance":"","ns":""},"count":3},"inc_marker":{"position":"00000000006.42.5"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.118.1"}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj8","instance":"","ns":""},"count":3},"inc_marker":{"position":"00000000006.28.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.42.1"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.66.1"}}}] 2021-07-26T15:50:57.976 WARNING:rgw_multi.tests:bucket mnwbfc-42 zone test-zone2 behind zone test-zone1: shard=1 master=00000000004.45.1 target=, shard=5 master=00000000004.37.1 target=, shard=9 master=00000000004.34.1 target= 2021-07-26T15:51:02.978 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:02.979 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:02.980 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-42 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:51:03.022 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:51:03.023 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:51:03.235 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj7","instance":"","ns":""},"count":3},"inc_marker":{"position":"00000000006.72.5"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.45.1"}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj6","instance":"","ns":""},"count":3},"inc_marker":{"position":"00000000006.37.5"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.36.1"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj5","instance":"","ns":""},"count":3},"inc_marker":{"position":"00000000006.42.5"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.37.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.118.1"}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj8","instance":"","ns":""},"count":3},"inc_marker":{"position":"00000000006.28.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.42.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.34.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.66.1"}}}] 2021-07-26T15:51:03.236 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=mnwbfc-42 2021-07-26T15:51:03.236 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-42', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:03.237 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-42', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:03.237 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-42 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:51:03.279 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:51:03.280 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:51:03.479 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":"00000000006.72.5"},{"key":1,"val":"00000000004.45.1"},{"key":2,"val":"00000000006.37.5"},{"key":3,"val":"00000000004.36.1"},{"key":4,"val":"00000000006.42.5"},{"key":5,"val":"00000000004.37.1"},{"key":6,"val":"00000000004.118.1"},{"key":7,"val":"00000000006.28.5"},{"key":8,"val":"00000000004.42.1"},{"key":9,"val":"00000000004.34.1"},{"key":10,"val":"00000000004.66.1"}]} 2021-07-26T15:51:03.479 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-42 2021-07-26T15:51:03.482 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:03.483 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:03.483 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-42 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:51:03.528 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:51:03.528 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:51:03.729 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.72.5"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.45.1"}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.37.5"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.36.1"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.42.5"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.37.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.118.1"}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.28.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.42.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.34.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.66.1"}}}] 2021-07-26T15:51:03.729 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-42 2021-07-26T15:51:03.730 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:03.731 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:03.731 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-42 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:51:03.771 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:51:03.771 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:51:03.956 INFO:teuthology.orchestra.run.smithi197.stdout:{"markers":[{"key":0,"val":"00000000004.64.5"},{"key":1,"val":"00000000002.43.1"},{"key":2,"val":"00000000004.42.5"},{"key":3,"val":"00000000002.32.1"},{"key":4,"val":"00000000004.39.5"},{"key":5,"val":"00000000002.35.1"},{"key":6,"val":"00000000002.128.1"},{"key":7,"val":"00000000004.27.5"},{"key":8,"val":"00000000002.46.1"},{"key":9,"val":"00000000002.44.1"},{"key":10,"val":"00000000002.59.1"}]} 2021-07-26T15:51:03.956 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=mnwbfc-42 2021-07-26T15:51:03.957 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'mnwbfc-42', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:03.958 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'mnwbfc-42', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:03.958 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket mnwbfc-42 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:51:04.001 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:51:04.001 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:51:04.212 INFO:teuthology.orchestra.run.smithi183.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj3","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000004.64.5"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.43.1"}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj2","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000004.42.5"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.32.1"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj1","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000004.39.5"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.35.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.128.1"}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000004.27.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.46.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.44.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.59.1"}}}] 2021-07-26T15:51:04.213 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=mnwbfc-42 2021-07-26T15:51:04.213 INFO:tasks.rgw_multi.zone_rados:comparing bucket=mnwbfc-42 zones={test-zone2, test-zone1} 2021-07-26T15:51:04.222 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:51:04.228 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-07-26T15:51:04.229 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-07-26T15:51:04.229 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-07-26T15:51:04.230 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-07-26T15:51:04.230 DEBUG:tasks.rgw_multi.zone_rados:o=obj5 2021-07-26T15:51:04.230 DEBUG:tasks.rgw_multi.zone_rados:o=obj6 2021-07-26T15:51:04.231 DEBUG:tasks.rgw_multi.zone_rados:o=obj7 2021-07-26T15:51:04.231 DEBUG:tasks.rgw_multi.zone_rados:o=obj8 2021-07-26T15:51:04.232 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:51:04.237 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-07-26T15:51:04.238 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-07-26T15:51:04.238 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-07-26T15:51:04.239 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-07-26T15:51:04.239 DEBUG:tasks.rgw_multi.zone_rados:o=obj5 2021-07-26T15:51:04.240 DEBUG:tasks.rgw_multi.zone_rados:o=obj6 2021-07-26T15:51:04.240 DEBUG:tasks.rgw_multi.zone_rados:o=obj7 2021-07-26T15:51:04.241 DEBUG:tasks.rgw_multi.zone_rados:o=obj8 2021-07-26T15:51:04.251 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-07-26T15:51:04.304 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-07-26T15:51:04.410 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-07-26T15:51:04.513 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-07-26T15:51:04.568 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-07-26T15:51:04.674 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-07-26T15:51:04.776 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-07-26T15:51:04.830 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-07-26T15:51:04.937 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-07-26T15:51:05.036 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-07-26T15:51:05.092 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-07-26T15:51:05.206 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-07-26T15:51:05.308 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2021-07-26T15:51:05.363 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2021-07-26T15:51:05.475 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2021-07-26T15:51:05.577 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2021-07-26T15:51:05.632 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2021-07-26T15:51:05.742 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2021-07-26T15:51:05.844 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2021-07-26T15:51:05.900 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2021-07-26T15:51:06.005 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2021-07-26T15:51:06.104 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2021-07-26T15:51:06.159 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2021-07-26T15:51:06.267 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2021-07-26T15:51:06.373 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=mnwbfc-42 zones={test-zone2, test-zone1} 2021-07-26T15:51:06.373 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-43', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:06.374 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-43', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:06.374 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-43 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:51:06.412 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:51:06.413 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:51:06.596 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":"00000000006.37.5"},{"key":1,"val":"00000000004.43.1"},{"key":2,"val":"00000000006.48.5"},{"key":3,"val":"00000000004.22.1"},{"key":4,"val":"00000000006.56.5"},{"key":5,"val":"00000000004.70.1"},{"key":6,"val":"00000000004.30.1"},{"key":7,"val":"00000000006.57.5"},{"key":8,"val":"00000000004.40.1"},{"key":9,"val":"00000000004.23.1"},{"key":10,"val":"00000000004.31.1"}]} 2021-07-26T15:51:06.597 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=mnwbfc-43 2021-07-26T15:51:06.597 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-43', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:06.598 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-43', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:06.598 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-43 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:51:06.642 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:51:06.642 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:51:06.842 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj3","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.37.5"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.43.1"}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj2","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.48.5"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.22.1"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj1","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.56.5"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.70.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.30.1"}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.57.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.40.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.23.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.31.1"}}}] 2021-07-26T15:51:06.843 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=mnwbfc-43 2021-07-26T15:51:06.843 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-43', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:06.844 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-43', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:06.845 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-43 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:51:06.886 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:51:06.886 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:51:07.092 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":"00000000006.37.5"},{"key":1,"val":"00000000004.43.1"},{"key":2,"val":"00000000006.48.5"},{"key":3,"val":"00000000004.22.1"},{"key":4,"val":"00000000006.56.5"},{"key":5,"val":"00000000004.70.1"},{"key":6,"val":"00000000004.30.1"},{"key":7,"val":"00000000006.57.5"},{"key":8,"val":"00000000004.40.1"},{"key":9,"val":"00000000004.23.1"},{"key":10,"val":"00000000004.31.1"}]} 2021-07-26T15:51:07.092 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-43 2021-07-26T15:51:07.093 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-43', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:07.093 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-43', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:07.094 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-43 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:51:07.138 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:51:07.138 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:51:07.343 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.37.5"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.43.1"}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.48.5"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.22.1"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.56.5"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.70.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.30.1"}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.57.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.40.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.23.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.31.1"}}}] 2021-07-26T15:51:07.344 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-43 2021-07-26T15:51:07.344 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-43', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:07.345 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-43', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:07.345 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-43 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:51:07.424 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:51:07.425 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:51:07.629 INFO:teuthology.orchestra.run.smithi197.stdout:{"markers":[{"key":0,"val":"00000000004.61.1"},{"key":1,"val":"00000000002.46.1"},{"key":2,"val":"00000000004.51.1"},{"key":3,"val":"00000000002.19.1"},{"key":4,"val":"00000000004.54.1"},{"key":5,"val":"00000000002.65.1"},{"key":6,"val":"00000000002.37.1"},{"key":7,"val":"00000000004.55.1"},{"key":8,"val":"00000000002.40.1"},{"key":9,"val":"00000000002.22.1"},{"key":10,"val":"00000000002.35.1"}]} 2021-07-26T15:51:07.630 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=mnwbfc-43 2021-07-26T15:51:07.630 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'mnwbfc-43', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:07.631 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'mnwbfc-43', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:07.631 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket mnwbfc-43 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:51:07.676 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:51:07.677 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:51:07.891 INFO:teuthology.orchestra.run.smithi183.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj7","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000004.61.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.46.1"}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj6","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000004.51.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.19.1"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj5","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000004.54.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.65.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.37.1"}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj8","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000004.55.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.40.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.22.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.35.1"}}}] 2021-07-26T15:51:07.892 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=mnwbfc-43 2021-07-26T15:51:07.892 INFO:tasks.rgw_multi.zone_rados:comparing bucket=mnwbfc-43 zones={test-zone2, test-zone1} 2021-07-26T15:51:07.900 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:51:07.906 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-07-26T15:51:07.907 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-07-26T15:51:07.907 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-07-26T15:51:07.907 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-07-26T15:51:07.908 DEBUG:tasks.rgw_multi.zone_rados:o=obj5 2021-07-26T15:51:07.908 DEBUG:tasks.rgw_multi.zone_rados:o=obj6 2021-07-26T15:51:07.909 DEBUG:tasks.rgw_multi.zone_rados:o=obj7 2021-07-26T15:51:07.909 DEBUG:tasks.rgw_multi.zone_rados:o=obj8 2021-07-26T15:51:07.910 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:51:07.916 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-07-26T15:51:07.917 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-07-26T15:51:07.917 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-07-26T15:51:07.918 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-07-26T15:51:07.918 DEBUG:tasks.rgw_multi.zone_rados:o=obj5 2021-07-26T15:51:07.918 DEBUG:tasks.rgw_multi.zone_rados:o=obj6 2021-07-26T15:51:07.919 DEBUG:tasks.rgw_multi.zone_rados:o=obj7 2021-07-26T15:51:07.919 DEBUG:tasks.rgw_multi.zone_rados:o=obj8 2021-07-26T15:51:07.930 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-07-26T15:51:07.983 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-07-26T15:51:08.091 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-07-26T15:51:08.193 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-07-26T15:51:08.252 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-07-26T15:51:08.362 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-07-26T15:51:08.467 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-07-26T15:51:08.519 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-07-26T15:51:08.630 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-07-26T15:51:08.729 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-07-26T15:51:08.784 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-07-26T15:51:08.895 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-07-26T15:51:08.999 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2021-07-26T15:51:09.055 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2021-07-26T15:51:09.161 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2021-07-26T15:51:09.260 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2021-07-26T15:51:09.316 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2021-07-26T15:51:09.422 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2021-07-26T15:51:09.524 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2021-07-26T15:51:09.579 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2021-07-26T15:51:09.690 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2021-07-26T15:51:09.788 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2021-07-26T15:51:09.843 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2021-07-26T15:51:09.950 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2021-07-26T15:51:10.052 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=mnwbfc-43 zones={test-zone2, test-zone1} 2021-07-26T15:51:10.053 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:10.054 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:10.054 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:51:10.090 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:51:10.091 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:51:10.289 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"1_1627314651.814636_261.2","last_update":"2021-07-26T15:50:51.814636Z"},{"marker":"1_1627314651.814636_436.3","last_update":"2021-07-26T15:50:51.814636Z"},{"marker":"1_1627314651.814636_226.3","last_update":"2021-07-26T15:50:51.814636Z"},{"marker":"1_1627314651.814636_492.3","last_update":"2021-07-26T15:50:51.814636Z"}] 2021-07-26T15:51:10.289 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2021-07-26T15:51:10.290 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:10.290 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:10.291 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:51:10.332 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:51:10.333 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:51:10.527 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":18132629931907925738},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314651.814636_261.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:51.814636Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314651.814636_436.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:51.814636Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314651.814636_226.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:51.814636Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314651.814636_492.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:51.814636Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T15:51:10.528 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2021-07-26T15:51:10.528 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:10.529 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:10.530 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:51:10.567 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:51:10.567 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:51:10.772 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"1_1627314651.814636_261.2","last_update":"2021-07-26T15:50:51.814636Z"},{"marker":"1_1627314651.814636_436.3","last_update":"2021-07-26T15:50:51.814636Z"},{"marker":"1_1627314651.814636_226.3","last_update":"2021-07-26T15:50:51.814636Z"},{"marker":"1_1627314651.814636_492.3","last_update":"2021-07-26T15:50:51.814636Z"}] 2021-07-26T15:51:10.773 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone3 source_zone=test-zone1 2021-07-26T15:51:10.773 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:10.774 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:10.775 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:51:10.819 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:51:10.819 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:51:11.004 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":3487142670906618468},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314651.814636_261.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:51.814636Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314651.814636_436.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:51.814636Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314651.814636_226.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:51.814636Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314651.814636_492.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:51.814636Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T15:51:11.005 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone3 source_zone=test-zone1 2021-07-26T15:51:11.005 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:11.006 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:11.006 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:51:11.083 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:51:11.083 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:51:11.280 INFO:teuthology.orchestra.run.smithi197.stdout:[{"marker":"1_1627314651.709016_215.1","last_update":"2021-07-26T15:50:51.709016Z"},{"marker":"1_1627314651.715166_432.1","last_update":"2021-07-26T15:50:51.715166Z"},{"marker":"1_1627314651.716900_279.1","last_update":"2021-07-26T15:50:51.716900Z"},{"marker":"1_1627314651.718435_498.1","last_update":"2021-07-26T15:50:51.718435Z"}] 2021-07-26T15:51:11.281 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2021-07-26T15:51:11.281 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:11.282 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:11.282 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:51:11.326 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:51:11.326 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:51:11.527 INFO:teuthology.orchestra.run.smithi183.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":8875080199853872167},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314651.709016_215.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:51.709016Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314651.715166_432.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:51.715166Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314651.716900_279.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:51.716900Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314651.718435_498.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:51.718435Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T15:51:11.527 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2021-07-26T15:51:11.528 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_sync_enable_right_after_disable ... ok 2021-07-26T15:51:11.529 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=mnwbfc-44 2021-07-26T15:51:11.556 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=mnwbfc-45 2021-07-26T15:51:11.626 INFO:tasks.rgw.c2.client.0.smithi197.stdout:2021-07-26T15:51:11.621+0000 7fa8a57fa700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:51:11.626 INFO:tasks.rgw.c2.client.1.smithi197.stdout:2021-07-26T15:51:11.621+0000 7f43f6ff5700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:51:11.627 INFO:tasks.rgw.c2.client.0.smithi197.stdout:2021-07-26T15:51:11.625+0000 7fa8997f2700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:51:11.628 INFO:tasks.rgw.c2.client.1.smithi197.stdout:2021-07-26T15:51:11.625+0000 7f4401ffb700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:51:11.987 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:11.988 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:11.988 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:51:12.022 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:51:12.023 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:51:12.165 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=816a1f73-b2bd-4f0e-a507-b6c39ba8a110 2021-07-26T15:51:12.195 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314671.582359_407.1","last_update":"2021-07-26T15:51:11.582359Z"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:51:12.196 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:51:12.196 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:12.197 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:12.197 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:51:12.240 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:51:12.240 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:51:12.418 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314671.582359_407.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:51:11.582359Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:51:12.419 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:51:12.419 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:51:12.420 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:12.420 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:12.421 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:51:12.459 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:51:12.459 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:51:12.644 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314671.582359_407.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:51:11.582359Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:51:12.645 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:51:12.645 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-44', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:12.646 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-44', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:12.647 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-44 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:51:12.686 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:51:12.687 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:51:12.887 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":"00000000001.27.5"},{"key":1,"val":""},{"key":2,"val":"00000000001.41.5"},{"key":3,"val":""},{"key":4,"val":"00000000001.39.5"},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000001.29.5"},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:51:12.888 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=mnwbfc-44 2021-07-26T15:51:12.888 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:12.889 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:12.889 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:51:12.934 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:51:12.934 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:51:13.161 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj3","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.27.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj2","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.41.5"}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj1","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.39.5"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.29.5"}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:51:13.161 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=mnwbfc-44 2021-07-26T15:51:13.162 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-44', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:13.162 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-44', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:13.163 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-44 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:51:13.203 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:51:13.203 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:51:13.397 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":"00000000001.27.5"},{"key":1,"val":""},{"key":2,"val":"00000000001.41.5"},{"key":3,"val":""},{"key":4,"val":"00000000001.39.5"},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000001.29.5"},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:51:13.397 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-44 2021-07-26T15:51:13.398 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:13.399 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:13.399 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:51:13.443 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:51:13.443 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:51:13.638 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.27.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.41.5"}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.39.5"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.29.5"}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:51:13.638 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-44 2021-07-26T15:51:13.639 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:13.639 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:13.640 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:51:13.677 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:51:13.677 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:51:13.859 INFO:teuthology.orchestra.run.smithi197.stdout:{"markers":[{"key":0,"val":"00000000001.34.5"},{"key":1,"val":""},{"key":2,"val":"00000000001.52.5"},{"key":3,"val":""},{"key":4,"val":"00000000001.50.5"},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000001.32.5"},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:51:13.859 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=mnwbfc-44 2021-07-26T15:51:13.860 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'mnwbfc-44', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:13.861 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'mnwbfc-44', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:13.861 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket mnwbfc-44 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:51:13.904 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:51:13.905 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:51:14.115 INFO:teuthology.orchestra.run.smithi183.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj3","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.34.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj2","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.52.5"}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj1","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.50.5"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.32.5"}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:51:14.116 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=mnwbfc-44 2021-07-26T15:51:14.116 INFO:tasks.rgw_multi.zone_rados:comparing bucket=mnwbfc-44 zones={test-zone2, test-zone1} 2021-07-26T15:51:14.125 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:51:14.129 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-07-26T15:51:14.130 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-07-26T15:51:14.130 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-07-26T15:51:14.131 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-07-26T15:51:14.132 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:51:14.179 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-07-26T15:51:14.180 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-07-26T15:51:14.180 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-07-26T15:51:14.180 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-07-26T15:51:14.235 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-07-26T15:51:14.294 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-07-26T15:51:14.401 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-07-26T15:51:14.504 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-07-26T15:51:14.559 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-07-26T15:51:14.661 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-07-26T15:51:14.760 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-07-26T15:51:14.815 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-07-26T15:51:14.919 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-07-26T15:51:15.018 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-07-26T15:51:15.077 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-07-26T15:51:15.190 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-07-26T15:51:15.288 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=mnwbfc-44 zones={test-zone2, test-zone1} 2021-07-26T15:51:15.289 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:15.290 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:15.291 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-45 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:51:15.332 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:51:15.333 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:51:15.541 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":"00000000001.35.5"},{"key":1,"val":""},{"key":2,"val":"00000000001.37.5"},{"key":3,"val":""},{"key":4,"val":"00000000001.35.5"},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000001.38.5"},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:51:15.542 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=mnwbfc-45 2021-07-26T15:51:15.543 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-45', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:15.543 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-45', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:15.544 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-45 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:51:15.587 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:51:15.588 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:51:15.796 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj3","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.35.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj2","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.37.5"}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj1","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.35.5"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.38.5"}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:51:15.797 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=mnwbfc-45 2021-07-26T15:51:15.798 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:15.799 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:15.800 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-45 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:51:15.839 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:51:15.840 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:51:16.065 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":"00000000001.35.5"},{"key":1,"val":""},{"key":2,"val":"00000000001.37.5"},{"key":3,"val":""},{"key":4,"val":"00000000001.35.5"},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000001.38.5"},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:51:16.066 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-45 2021-07-26T15:51:16.066 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-45', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:16.067 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-45', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:16.068 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-45 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:51:16.110 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:51:16.111 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:51:16.319 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.35.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.37.5"}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.35.5"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.38.5"}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:51:16.320 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-45 2021-07-26T15:51:16.321 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-45', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:16.321 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-45', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:16.322 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-45 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:51:16.359 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:51:16.359 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:51:16.564 INFO:teuthology.orchestra.run.smithi197.stdout:{"markers":[{"key":0,"val":"00000000001.39.5"},{"key":1,"val":""},{"key":2,"val":"00000000001.45.5"},{"key":3,"val":""},{"key":4,"val":"00000000001.44.5"},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000001.33.5"},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:51:16.564 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=mnwbfc-45 2021-07-26T15:51:16.565 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'mnwbfc-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:16.566 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'mnwbfc-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:16.566 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket mnwbfc-45 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:51:16.608 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:51:16.609 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:51:16.826 INFO:teuthology.orchestra.run.smithi183.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj3","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.39.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj2","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.45.5"}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj1","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.44.5"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.33.5"}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:51:16.827 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=mnwbfc-45 2021-07-26T15:51:16.827 INFO:tasks.rgw_multi.zone_rados:comparing bucket=mnwbfc-45 zones={test-zone2, test-zone1} 2021-07-26T15:51:16.836 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:51:16.841 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-07-26T15:51:16.842 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-07-26T15:51:16.842 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-07-26T15:51:16.842 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-07-26T15:51:16.843 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:51:16.895 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-07-26T15:51:16.896 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-07-26T15:51:16.896 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-07-26T15:51:16.897 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-07-26T15:51:16.951 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-07-26T15:51:17.122 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-07-26T15:51:17.267 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-07-26T15:51:17.368 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-07-26T15:51:17.423 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-07-26T15:51:17.530 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-07-26T15:51:17.632 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-07-26T15:51:17.687 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-07-26T15:51:17.797 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-07-26T15:51:17.896 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-07-26T15:51:17.951 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-07-26T15:51:18.058 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-07-26T15:51:18.161 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=mnwbfc-45 zones={test-zone2, test-zone1} 2021-07-26T15:51:18.162 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'disable', '--bucket', 'mnwbfc-44', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:51:18.163 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'disable', '--bucket', 'mnwbfc-44', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:51:18.163 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync disable --bucket mnwbfc-44 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:51:18.202 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:51:18.203 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:51:18.466 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'disable', '--bucket', 'mnwbfc-45', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:51:18.466 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'disable', '--bucket', 'mnwbfc-45', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:51:18.467 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync disable --bucket mnwbfc-45 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:51:18.550 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:51:18.551 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:51:18.818 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:18.818 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:18.819 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:51:18.857 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:51:18.857 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:51:19.040 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=816a1f73-b2bd-4f0e-a507-b6c39ba8a110 2021-07-26T15:51:19.075 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314678.775463_411.1","last_update":"2021-07-26T15:51:18.775463Z"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:51:19.075 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:51:19.076 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:19.076 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:19.077 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:51:19.121 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:51:19.122 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:51:19.330 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314671.582359_407.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:51:11.582359Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:51:19.331 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314678.775463_411.1 target=1_1627314671.582359_407.1 2021-07-26T15:51:24.332 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:24.333 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:24.334 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:51:24.376 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:51:24.377 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:51:24.576 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314671.582359_407.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:51:11.582359Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:51:24.577 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314678.775463_411.1 target=1_1627314671.582359_407.1 2021-07-26T15:51:29.578 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:29.579 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:29.580 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:51:29.619 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:51:29.619 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:51:29.807 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314678.775463_411.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:51:18.775463Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:51:29.807 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:51:29.808 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:51:29.808 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:29.809 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:29.810 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:51:29.843 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:51:29.844 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:51:30.028 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314678.775463_411.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:51:18.775463Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:51:30.029 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:51:30.424 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'enable', '--bucket', 'mnwbfc-44', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:51:30.425 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'enable', '--bucket', 'mnwbfc-44', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:51:30.425 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync enable --bucket mnwbfc-44 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:51:30.466 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:51:30.466 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:51:30.716 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'enable', '--bucket', 'mnwbfc-45', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:51:30.717 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'enable', '--bucket', 'mnwbfc-45', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:51:30.717 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync enable --bucket mnwbfc-45 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:51:30.795 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:51:30.795 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:51:31.065 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-44', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:31.066 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-44', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:31.066 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-44 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:51:31.104 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:51:31.104 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:51:31.339 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":"00000000006.40.1"},{"key":1,"val":"00000000004.123.1"},{"key":2,"val":"00000000006.54.1"},{"key":3,"val":"00000000004.36.1"},{"key":4,"val":"00000000006.55.1"},{"key":5,"val":"00000000004.48.1"},{"key":6,"val":"00000000004.41.1"},{"key":7,"val":"00000000006.41.1"},{"key":8,"val":"00000000004.37.1"},{"key":9,"val":"00000000004.55.1"},{"key":10,"val":"00000000004.34.1"}]} 2021-07-26T15:51:31.340 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=mnwbfc-44 2021-07-26T15:51:31.340 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:31.341 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:31.342 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:51:31.383 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:51:31.383 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:51:31.639 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj7","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.40.1"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj6","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.54.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.36.1"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj5","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.55.1"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj8","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.41.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.37.1"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.34.1"}}}] 2021-07-26T15:51:31.640 WARNING:rgw_multi.tests:bucket mnwbfc-44 zone test-zone2 behind zone test-zone1: shard=1 master=00000000004.123.1 target=, shard=5 master=00000000004.48.1 target=, shard=9 master=00000000004.55.1 target= 2021-07-26T15:51:36.640 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:36.641 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:36.642 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:51:36.685 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:51:36.686 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:51:36.905 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj7","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.40.1"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj6","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.54.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.36.1"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj5","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.55.1"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj8","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.41.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.37.1"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.34.1"}}}] 2021-07-26T15:51:36.905 WARNING:rgw_multi.tests:bucket mnwbfc-44 zone test-zone2 behind zone test-zone1: shard=1 master=00000000004.123.1 target=, shard=5 master=00000000004.48.1 target=, shard=9 master=00000000004.55.1 target= 2021-07-26T15:51:41.907 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:41.908 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:41.908 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:51:41.956 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:51:41.957 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:51:42.171 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj7","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.40.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.123.1"}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj6","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.54.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.36.1"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj5","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.55.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.48.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj8","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.41.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.37.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.55.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.34.1"}}}] 2021-07-26T15:51:42.172 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=mnwbfc-44 2021-07-26T15:51:42.172 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-44', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:42.173 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-44', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:42.173 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-44 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:51:42.214 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:51:42.215 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:51:42.439 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":"00000000006.40.1"},{"key":1,"val":"00000000004.123.1"},{"key":2,"val":"00000000006.54.1"},{"key":3,"val":"00000000004.36.1"},{"key":4,"val":"00000000006.55.1"},{"key":5,"val":"00000000004.48.1"},{"key":6,"val":"00000000004.41.1"},{"key":7,"val":"00000000006.41.1"},{"key":8,"val":"00000000004.37.1"},{"key":9,"val":"00000000004.55.1"},{"key":10,"val":"00000000004.34.1"}]} 2021-07-26T15:51:42.440 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-44 2021-07-26T15:51:42.440 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:42.441 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:42.444 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:51:42.486 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:51:42.487 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:51:42.684 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.30.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.123.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.36.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.43.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.48.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.31.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.37.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.55.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.34.1"}}}] 2021-07-26T15:51:42.685 WARNING:rgw_multi.tests:bucket mnwbfc-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.40.1 target=00000000002.30.1, shard=2 master=00000000006.54.1 target=00000000002.42.1, shard=4 master=00000000006.55.1 target=00000000002.43.1, shard=7 master=00000000006.41.1 target=00000000002.31.1 2021-07-26T15:51:47.686 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:47.687 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:47.689 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:51:47.732 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:51:47.733 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:51:47.928 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.30.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.123.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.36.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.43.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.48.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.31.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.37.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.55.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.34.1"}}}] 2021-07-26T15:51:48.035 WARNING:rgw_multi.tests:bucket mnwbfc-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.40.1 target=00000000002.30.1, shard=2 master=00000000006.54.1 target=00000000002.42.1, shard=4 master=00000000006.55.1 target=00000000002.43.1, shard=7 master=00000000006.41.1 target=00000000002.31.1 2021-07-26T15:51:53.037 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:53.038 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:53.039 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:51:53.082 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:51:53.083 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:51:53.293 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.30.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.123.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.36.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.43.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.48.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.31.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.37.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.55.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.34.1"}}}] 2021-07-26T15:51:53.294 WARNING:rgw_multi.tests:bucket mnwbfc-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.40.1 target=00000000002.30.1, shard=2 master=00000000006.54.1 target=00000000002.42.1, shard=4 master=00000000006.55.1 target=00000000002.43.1, shard=7 master=00000000006.41.1 target=00000000002.31.1 2021-07-26T15:51:58.297 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:58.298 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:58.299 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:51:58.342 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:51:58.342 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:51:58.547 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.30.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.123.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.36.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.43.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.48.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.31.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.37.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.55.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.34.1"}}}] 2021-07-26T15:51:58.548 WARNING:rgw_multi.tests:bucket mnwbfc-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.40.1 target=00000000002.30.1, shard=2 master=00000000006.54.1 target=00000000002.42.1, shard=4 master=00000000006.55.1 target=00000000002.43.1, shard=7 master=00000000006.41.1 target=00000000002.31.1 2021-07-26T15:52:03.549 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:52:03.550 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:52:03.551 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:52:03.594 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:52:03.595 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:52:03.797 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.30.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.123.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.36.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.43.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.48.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.31.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.37.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.55.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.34.1"}}}] 2021-07-26T15:52:03.798 WARNING:rgw_multi.tests:bucket mnwbfc-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.40.1 target=00000000002.30.1, shard=2 master=00000000006.54.1 target=00000000002.42.1, shard=4 master=00000000006.55.1 target=00000000002.43.1, shard=7 master=00000000006.41.1 target=00000000002.31.1 2021-07-26T15:52:08.799 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:52:08.800 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:52:08.800 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:52:08.847 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:52:08.848 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:52:09.056 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.30.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.123.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.36.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.43.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.48.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.31.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.37.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.55.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.34.1"}}}] 2021-07-26T15:52:09.057 WARNING:rgw_multi.tests:bucket mnwbfc-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.40.1 target=00000000002.30.1, shard=2 master=00000000006.54.1 target=00000000002.42.1, shard=4 master=00000000006.55.1 target=00000000002.43.1, shard=7 master=00000000006.41.1 target=00000000002.31.1 2021-07-26T15:52:14.058 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:52:14.060 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:52:14.061 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:52:14.105 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:52:14.106 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:52:14.312 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.30.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.123.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.36.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.43.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.48.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.31.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.37.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.55.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.34.1"}}}] 2021-07-26T15:52:14.312 WARNING:rgw_multi.tests:bucket mnwbfc-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.40.1 target=00000000002.30.1, shard=2 master=00000000006.54.1 target=00000000002.42.1, shard=4 master=00000000006.55.1 target=00000000002.43.1, shard=7 master=00000000006.41.1 target=00000000002.31.1 2021-07-26T15:52:19.314 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:52:19.315 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:52:19.316 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:52:19.362 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:52:19.362 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:52:19.555 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.30.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.123.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.36.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.43.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.48.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.31.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.37.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.55.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.34.1"}}}] 2021-07-26T15:52:19.555 WARNING:rgw_multi.tests:bucket mnwbfc-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.40.1 target=00000000002.30.1, shard=2 master=00000000006.54.1 target=00000000002.42.1, shard=4 master=00000000006.55.1 target=00000000002.43.1, shard=7 master=00000000006.41.1 target=00000000002.31.1 2021-07-26T15:52:24.557 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:52:24.559 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:52:24.561 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:52:24.609 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:52:24.610 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:52:24.804 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.30.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.123.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.36.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.43.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.48.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.31.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.37.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.55.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.34.1"}}}] 2021-07-26T15:52:24.805 WARNING:rgw_multi.tests:bucket mnwbfc-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.40.1 target=00000000002.30.1, shard=2 master=00000000006.54.1 target=00000000002.42.1, shard=4 master=00000000006.55.1 target=00000000002.43.1, shard=7 master=00000000006.41.1 target=00000000002.31.1 2021-07-26T15:52:29.806 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:52:29.807 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:52:29.808 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:52:29.851 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:52:29.852 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:52:30.060 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.30.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.123.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.36.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.43.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.48.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.31.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.37.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.55.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.34.1"}}}] 2021-07-26T15:52:30.060 WARNING:rgw_multi.tests:bucket mnwbfc-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.40.1 target=00000000002.30.1, shard=2 master=00000000006.54.1 target=00000000002.42.1, shard=4 master=00000000006.55.1 target=00000000002.43.1, shard=7 master=00000000006.41.1 target=00000000002.31.1 2021-07-26T15:52:35.062 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:52:35.063 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:52:35.063 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:52:35.106 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:52:35.107 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:52:35.326 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.30.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.123.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.36.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.43.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.48.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.31.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.37.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.55.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.34.1"}}}] 2021-07-26T15:52:35.327 WARNING:rgw_multi.tests:bucket mnwbfc-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.40.1 target=00000000002.30.1, shard=2 master=00000000006.54.1 target=00000000002.42.1, shard=4 master=00000000006.55.1 target=00000000002.43.1, shard=7 master=00000000006.41.1 target=00000000002.31.1 2021-07-26T15:52:40.328 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:52:40.328 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:52:40.329 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:52:40.373 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:52:40.373 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:52:40.578 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.30.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.123.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.36.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.43.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.48.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.31.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.37.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.55.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.34.1"}}}] 2021-07-26T15:52:40.579 WARNING:rgw_multi.tests:bucket mnwbfc-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.40.1 target=00000000002.30.1, shard=2 master=00000000006.54.1 target=00000000002.42.1, shard=4 master=00000000006.55.1 target=00000000002.43.1, shard=7 master=00000000006.41.1 target=00000000002.31.1 2021-07-26T15:52:45.580 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:52:45.580 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:52:45.581 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:52:45.623 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:52:45.623 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:52:45.828 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.30.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.123.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.36.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.43.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.48.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.31.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.37.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.55.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.34.1"}}}] 2021-07-26T15:52:45.829 WARNING:rgw_multi.tests:bucket mnwbfc-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.40.1 target=00000000002.30.1, shard=2 master=00000000006.54.1 target=00000000002.42.1, shard=4 master=00000000006.55.1 target=00000000002.43.1, shard=7 master=00000000006.41.1 target=00000000002.31.1 2021-07-26T15:52:50.830 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:52:50.831 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:52:50.831 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:52:50.876 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:52:50.877 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:52:51.091 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.30.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.123.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.36.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.43.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.48.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.31.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.37.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.55.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.34.1"}}}] 2021-07-26T15:52:51.092 WARNING:rgw_multi.tests:bucket mnwbfc-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.40.1 target=00000000002.30.1, shard=2 master=00000000006.54.1 target=00000000002.42.1, shard=4 master=00000000006.55.1 target=00000000002.43.1, shard=7 master=00000000006.41.1 target=00000000002.31.1 2021-07-26T15:52:56.093 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:52:56.093 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:52:56.094 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:52:56.139 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:52:56.139 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:52:56.346 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.30.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.123.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.36.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.43.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.48.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.31.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.37.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.55.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.34.1"}}}] 2021-07-26T15:52:56.347 WARNING:rgw_multi.tests:bucket mnwbfc-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.40.1 target=00000000002.30.1, shard=2 master=00000000006.54.1 target=00000000002.42.1, shard=4 master=00000000006.55.1 target=00000000002.43.1, shard=7 master=00000000006.41.1 target=00000000002.31.1 2021-07-26T15:53:01.348 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:01.350 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:01.351 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:53:01.397 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:01.397 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:01.604 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.30.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.123.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.36.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.43.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.48.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.31.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.37.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.55.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.34.1"}}}] 2021-07-26T15:53:01.605 WARNING:rgw_multi.tests:bucket mnwbfc-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.40.1 target=00000000002.30.1, shard=2 master=00000000006.54.1 target=00000000002.42.1, shard=4 master=00000000006.55.1 target=00000000002.43.1, shard=7 master=00000000006.41.1 target=00000000002.31.1 2021-07-26T15:53:06.606 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:06.607 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:06.608 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:53:06.658 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:06.659 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:06.844 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.30.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.123.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.36.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.43.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.48.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.31.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.37.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.55.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.34.1"}}}] 2021-07-26T15:53:06.844 WARNING:rgw_multi.tests:bucket mnwbfc-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.40.1 target=00000000002.30.1, shard=2 master=00000000006.54.1 target=00000000002.42.1, shard=4 master=00000000006.55.1 target=00000000002.43.1, shard=7 master=00000000006.41.1 target=00000000002.31.1 2021-07-26T15:53:11.845 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:11.847 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:11.848 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:53:11.894 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:11.894 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:12.118 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.30.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.123.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.36.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.43.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.48.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.31.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.37.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.55.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.34.1"}}}] 2021-07-26T15:53:12.118 WARNING:rgw_multi.tests:bucket mnwbfc-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.40.1 target=00000000002.30.1, shard=2 master=00000000006.54.1 target=00000000002.42.1, shard=4 master=00000000006.55.1 target=00000000002.43.1, shard=7 master=00000000006.41.1 target=00000000002.31.1 2021-07-26T15:53:17.121 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:17.121 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:17.122 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:53:17.167 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:17.168 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:17.394 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.30.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.123.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.36.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.43.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.48.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.31.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.37.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.55.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.34.1"}}}] 2021-07-26T15:53:17.394 WARNING:rgw_multi.tests:bucket mnwbfc-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.40.1 target=00000000002.30.1, shard=2 master=00000000006.54.1 target=00000000002.42.1, shard=4 master=00000000006.55.1 target=00000000002.43.1, shard=7 master=00000000006.41.1 target=00000000002.31.1 2021-07-26T15:53:22.396 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:22.397 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:22.398 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:53:22.445 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:22.446 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:22.657 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.30.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.123.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.36.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.43.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.48.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.31.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.37.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.55.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.34.1"}}}] 2021-07-26T15:53:22.657 WARNING:rgw_multi.tests:bucket mnwbfc-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.40.1 target=00000000002.30.1, shard=2 master=00000000006.54.1 target=00000000002.42.1, shard=4 master=00000000006.55.1 target=00000000002.43.1, shard=7 master=00000000006.41.1 target=00000000002.31.1 2021-07-26T15:53:27.659 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:27.660 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:27.660 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:53:27.702 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:27.702 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:27.911 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.30.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.123.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.36.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.43.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.48.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.31.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.37.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.55.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.34.1"}}}] 2021-07-26T15:53:27.912 WARNING:rgw_multi.tests:bucket mnwbfc-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.40.1 target=00000000002.30.1, shard=2 master=00000000006.54.1 target=00000000002.42.1, shard=4 master=00000000006.55.1 target=00000000002.43.1, shard=7 master=00000000006.41.1 target=00000000002.31.1 2021-07-26T15:53:32.913 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:32.914 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:32.916 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:53:32.961 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:32.961 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:33.174 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.30.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.123.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.36.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.43.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.48.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.31.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.37.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.55.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.34.1"}}}] 2021-07-26T15:53:33.175 WARNING:rgw_multi.tests:bucket mnwbfc-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.40.1 target=00000000002.30.1, shard=2 master=00000000006.54.1 target=00000000002.42.1, shard=4 master=00000000006.55.1 target=00000000002.43.1, shard=7 master=00000000006.41.1 target=00000000002.31.1 2021-07-26T15:53:38.176 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:38.177 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:38.178 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:53:38.223 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:38.223 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:38.445 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.30.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.123.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.36.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.43.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.48.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.31.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.37.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.55.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.34.1"}}}] 2021-07-26T15:53:38.446 WARNING:rgw_multi.tests:bucket mnwbfc-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.40.1 target=00000000002.30.1, shard=2 master=00000000006.54.1 target=00000000002.42.1, shard=4 master=00000000006.55.1 target=00000000002.43.1, shard=7 master=00000000006.41.1 target=00000000002.31.1 2021-07-26T15:53:43.447 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:43.448 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:43.449 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:53:43.493 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:43.493 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:43.709 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.30.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.123.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.36.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.43.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.48.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.31.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.37.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.55.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.34.1"}}}] 2021-07-26T15:53:43.710 WARNING:rgw_multi.tests:bucket mnwbfc-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.40.1 target=00000000002.30.1, shard=2 master=00000000006.54.1 target=00000000002.42.1, shard=4 master=00000000006.55.1 target=00000000002.43.1, shard=7 master=00000000006.41.1 target=00000000002.31.1 2021-07-26T15:53:48.711 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:48.712 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:48.713 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:53:48.755 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:48.756 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:48.966 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.30.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.123.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.36.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.43.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.48.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.31.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.37.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.55.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.34.1"}}}] 2021-07-26T15:53:48.968 WARNING:rgw_multi.tests:bucket mnwbfc-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.40.1 target=00000000002.30.1, shard=2 master=00000000006.54.1 target=00000000002.42.1, shard=4 master=00000000006.55.1 target=00000000002.43.1, shard=7 master=00000000006.41.1 target=00000000002.31.1 2021-07-26T15:53:53.969 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:53.970 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:53.971 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:53:54.015 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:54.016 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:54.234 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.30.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.123.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.36.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.43.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.48.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.31.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.37.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.55.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.34.1"}}}] 2021-07-26T15:53:54.235 WARNING:rgw_multi.tests:bucket mnwbfc-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.40.1 target=00000000002.30.1, shard=2 master=00000000006.54.1 target=00000000002.42.1, shard=4 master=00000000006.55.1 target=00000000002.43.1, shard=7 master=00000000006.41.1 target=00000000002.31.1 2021-07-26T15:53:59.236 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:59.237 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:59.238 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:53:59.288 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:59.289 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:59.514 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.30.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.123.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.36.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.43.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.48.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.31.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.37.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.55.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.34.1"}}}] 2021-07-26T15:53:59.515 WARNING:rgw_multi.tests:bucket mnwbfc-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.40.1 target=00000000002.30.1, shard=2 master=00000000006.54.1 target=00000000002.42.1, shard=4 master=00000000006.55.1 target=00000000002.43.1, shard=7 master=00000000006.41.1 target=00000000002.31.1 2021-07-26T15:54:04.517 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:04.519 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:04.519 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:04.564 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:04.564 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:04.794 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.40.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.123.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.36.1"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.55.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.48.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.41.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.37.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.55.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.34.1"}}}] 2021-07-26T15:54:04.795 WARNING:rgw_multi.tests:bucket mnwbfc-44 zone test-zone3 behind zone test-zone1: shard=2 master=00000000006.54.1 target=00000000002.42.1 2021-07-26T15:54:09.799 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:09.799 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:09.800 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:09.850 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:09.851 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:10.061 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.40.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.123.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.36.1"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.55.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.48.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.41.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.37.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.55.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.34.1"}}}] 2021-07-26T15:54:10.062 WARNING:rgw_multi.tests:bucket mnwbfc-44 zone test-zone3 behind zone test-zone1: shard=2 master=00000000006.54.1 target=00000000002.42.1 2021-07-26T15:54:15.092 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:15.093 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:15.094 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:15.139 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:15.139 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:15.351 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.40.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.123.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.36.1"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.55.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.48.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.41.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.37.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.55.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.34.1"}}}] 2021-07-26T15:54:15.352 WARNING:rgw_multi.tests:bucket mnwbfc-44 zone test-zone3 behind zone test-zone1: shard=2 master=00000000006.54.1 target=00000000002.42.1 2021-07-26T15:54:20.353 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:20.354 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:20.354 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:20.401 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:20.401 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:20.622 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.40.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.123.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.36.1"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.55.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.48.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.41.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.37.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.55.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.34.1"}}}] 2021-07-26T15:54:20.623 WARNING:rgw_multi.tests:bucket mnwbfc-44 zone test-zone3 behind zone test-zone1: shard=2 master=00000000006.54.1 target=00000000002.42.1 2021-07-26T15:54:25.625 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:25.626 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:25.626 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:25.669 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:25.670 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:25.875 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.40.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.123.1"}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.54.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.36.1"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.55.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.48.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.41.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.37.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.55.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.34.1"}}}] 2021-07-26T15:54:25.876 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-44 2021-07-26T15:54:25.876 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:25.877 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:25.878 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:25.919 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:25.920 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:26.127 INFO:teuthology.orchestra.run.smithi197.stdout:{"markers":[{"key":0,"val":"00000000004.44.5"},{"key":1,"val":"00000000002.135.1"},{"key":2,"val":"00000000004.68.5"},{"key":3,"val":"00000000002.30.1"},{"key":4,"val":"00000000004.66.5"},{"key":5,"val":"00000000002.47.1"},{"key":6,"val":"00000000002.52.1"},{"key":7,"val":"00000000004.46.5"},{"key":8,"val":"00000000002.51.1"},{"key":9,"val":"00000000002.73.1"},{"key":10,"val":"00000000002.33.1"}]} 2021-07-26T15:54:26.128 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=mnwbfc-44 2021-07-26T15:54:26.128 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'mnwbfc-44', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:26.129 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'mnwbfc-44', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:26.129 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket mnwbfc-44 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:26.178 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:26.178 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:26.410 INFO:teuthology.orchestra.run.smithi183.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj3","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000004.44.5"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.135.1"}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj2","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000004.68.5"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.30.1"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj1","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000004.66.5"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.47.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.52.1"}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000004.46.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.51.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.73.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.33.1"}}}] 2021-07-26T15:54:26.410 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=mnwbfc-44 2021-07-26T15:54:26.411 INFO:tasks.rgw_multi.zone_rados:comparing bucket=mnwbfc-44 zones={test-zone2, test-zone1} 2021-07-26T15:54:26.424 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:54:26.431 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-07-26T15:54:26.432 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-07-26T15:54:26.432 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-07-26T15:54:26.433 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-07-26T15:54:26.433 DEBUG:tasks.rgw_multi.zone_rados:o=obj5 2021-07-26T15:54:26.434 DEBUG:tasks.rgw_multi.zone_rados:o=obj6 2021-07-26T15:54:26.434 DEBUG:tasks.rgw_multi.zone_rados:o=obj7 2021-07-26T15:54:26.435 DEBUG:tasks.rgw_multi.zone_rados:o=obj8 2021-07-26T15:54:26.436 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:54:26.483 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-07-26T15:54:26.484 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-07-26T15:54:26.484 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-07-26T15:54:26.485 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-07-26T15:54:26.485 DEBUG:tasks.rgw_multi.zone_rados:o=obj5 2021-07-26T15:54:26.486 DEBUG:tasks.rgw_multi.zone_rados:o=obj6 2021-07-26T15:54:26.486 DEBUG:tasks.rgw_multi.zone_rados:o=obj7 2021-07-26T15:54:26.487 DEBUG:tasks.rgw_multi.zone_rados:o=obj8 2021-07-26T15:54:26.499 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-07-26T15:54:26.552 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-07-26T15:54:26.662 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-07-26T15:54:26.765 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-07-26T15:54:26.819 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-07-26T15:54:26.927 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-07-26T15:54:27.030 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-07-26T15:54:27.087 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-07-26T15:54:27.195 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-07-26T15:54:27.294 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-07-26T15:54:27.353 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-07-26T15:54:27.468 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-07-26T15:54:27.572 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2021-07-26T15:54:27.629 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2021-07-26T15:54:27.743 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2021-07-26T15:54:27.848 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2021-07-26T15:54:27.905 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2021-07-26T15:54:28.019 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2021-07-26T15:54:28.121 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2021-07-26T15:54:28.175 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2021-07-26T15:54:28.282 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2021-07-26T15:54:28.384 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2021-07-26T15:54:28.440 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2021-07-26T15:54:28.549 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2021-07-26T15:54:28.653 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=mnwbfc-44 zones={test-zone2, test-zone1} 2021-07-26T15:54:28.654 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:28.655 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:28.655 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-45 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:28.694 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:28.694 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:28.906 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":"00000000006.45.5"},{"key":1,"val":"00000000004.57.1"},{"key":2,"val":"00000000006.43.5"},{"key":3,"val":"00000000004.43.1"},{"key":4,"val":"00000000006.45.5"},{"key":5,"val":"00000000004.28.1"},{"key":6,"val":"00000000004.23.1"},{"key":7,"val":"00000000006.44.5"},{"key":8,"val":"00000000004.39.1"},{"key":9,"val":"00000000004.42.1"},{"key":10,"val":"00000000004.29.1"}]} 2021-07-26T15:54:28.907 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=mnwbfc-45 2021-07-26T15:54:28.907 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-45', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:28.908 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-45', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:28.908 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-45 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:28.953 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:28.953 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:29.176 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj7","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.45.5"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.57.1"}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj6","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.43.5"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.43.1"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj5","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.45.5"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.28.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.23.1"}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj8","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.44.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.39.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.42.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.29.1"}}}] 2021-07-26T15:54:29.177 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=mnwbfc-45 2021-07-26T15:54:29.178 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:29.179 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:29.180 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-45 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:29.225 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:29.226 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:29.435 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":"00000000006.45.5"},{"key":1,"val":"00000000004.57.1"},{"key":2,"val":"00000000006.43.5"},{"key":3,"val":"00000000004.43.1"},{"key":4,"val":"00000000006.45.5"},{"key":5,"val":"00000000004.28.1"},{"key":6,"val":"00000000004.23.1"},{"key":7,"val":"00000000006.44.5"},{"key":8,"val":"00000000004.39.1"},{"key":9,"val":"00000000004.42.1"},{"key":10,"val":"00000000004.29.1"}]} 2021-07-26T15:54:29.436 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-45 2021-07-26T15:54:29.437 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-45', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:29.437 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-45', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:29.438 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-45 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:29.481 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:29.481 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:29.700 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.45.5"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.57.1"}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.43.5"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.43.1"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.45.5"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.28.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.23.1"}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.44.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.39.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.42.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.29.1"}}}] 2021-07-26T15:54:29.700 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-45 2021-07-26T15:54:29.701 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-45', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:29.701 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-45', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:29.702 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-45 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:29.739 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:29.740 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:29.933 INFO:teuthology.orchestra.run.smithi197.stdout:{"markers":[{"key":0,"val":"00000000004.46.1"},{"key":1,"val":"00000000002.56.1"},{"key":2,"val":"00000000004.50.1"},{"key":3,"val":"00000000002.47.1"},{"key":4,"val":"00000000004.51.1"},{"key":5,"val":"00000000002.31.1"},{"key":6,"val":"00000000002.25.1"},{"key":7,"val":"00000000004.38.1"},{"key":8,"val":"00000000002.54.1"},{"key":9,"val":"00000000002.66.1"},{"key":10,"val":"00000000002.34.1"}]} 2021-07-26T15:54:29.933 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=mnwbfc-45 2021-07-26T15:54:29.934 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'mnwbfc-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:29.935 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'mnwbfc-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:29.935 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket mnwbfc-45 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:29.979 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:29.980 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:30.204 INFO:teuthology.orchestra.run.smithi183.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj7","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000004.46.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.56.1"}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj6","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000004.50.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.47.1"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj5","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000004.51.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.31.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.25.1"}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj8","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000004.38.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.54.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.66.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.34.1"}}}] 2021-07-26T15:54:30.204 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=mnwbfc-45 2021-07-26T15:54:30.205 INFO:tasks.rgw_multi.zone_rados:comparing bucket=mnwbfc-45 zones={test-zone2, test-zone1} 2021-07-26T15:54:30.215 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:54:30.222 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-07-26T15:54:30.222 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-07-26T15:54:30.223 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-07-26T15:54:30.224 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-07-26T15:54:30.224 DEBUG:tasks.rgw_multi.zone_rados:o=obj5 2021-07-26T15:54:30.224 DEBUG:tasks.rgw_multi.zone_rados:o=obj6 2021-07-26T15:54:30.225 DEBUG:tasks.rgw_multi.zone_rados:o=obj7 2021-07-26T15:54:30.225 DEBUG:tasks.rgw_multi.zone_rados:o=obj8 2021-07-26T15:54:30.226 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:54:30.232 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-07-26T15:54:30.232 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-07-26T15:54:30.233 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-07-26T15:54:30.234 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-07-26T15:54:30.234 DEBUG:tasks.rgw_multi.zone_rados:o=obj5 2021-07-26T15:54:30.235 DEBUG:tasks.rgw_multi.zone_rados:o=obj6 2021-07-26T15:54:30.235 DEBUG:tasks.rgw_multi.zone_rados:o=obj7 2021-07-26T15:54:30.235 DEBUG:tasks.rgw_multi.zone_rados:o=obj8 2021-07-26T15:54:30.246 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-07-26T15:54:30.299 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-07-26T15:54:30.412 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-07-26T15:54:30.515 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-07-26T15:54:30.567 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-07-26T15:54:30.678 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-07-26T15:54:30.782 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-07-26T15:54:30.839 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-07-26T15:54:30.993 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-07-26T15:54:31.095 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-07-26T15:54:31.154 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-07-26T15:54:31.270 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-07-26T15:54:31.412 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2021-07-26T15:54:31.468 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2021-07-26T15:54:31.578 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2021-07-26T15:54:31.684 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2021-07-26T15:54:31.740 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2021-07-26T15:54:31.858 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2021-07-26T15:54:31.961 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2021-07-26T15:54:32.018 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2021-07-26T15:54:32.130 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2021-07-26T15:54:32.237 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2021-07-26T15:54:32.292 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2021-07-26T15:54:32.401 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2021-07-26T15:54:32.505 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=mnwbfc-45 zones={test-zone2, test-zone1} 2021-07-26T15:54:32.506 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:32.507 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:32.507 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:32.547 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:32.547 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:32.750 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"1_1627314695.258244_277.2","last_update":"2021-07-26T15:51:35.258244Z"},{"marker":"1_1627314695.258244_580.4","last_update":"2021-07-26T15:51:35.258244Z"},{"marker":"1_1627314691.033918_282.3","last_update":"2021-07-26T15:51:31.033918Z"},{"marker":"1_1627314695.258244_548.2","last_update":"2021-07-26T15:51:35.258244Z"}] 2021-07-26T15:54:32.750 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2021-07-26T15:54:32.751 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:32.751 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:32.752 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:32.791 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:32.791 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:32.992 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":18132629931907925738},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314695.258244_277.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:51:35.258244Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314695.258244_580.4","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:51:35.258244Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314691.033918_282.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:51:31.033918Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314695.258244_548.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:51:35.258244Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T15:54:32.993 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2021-07-26T15:54:32.993 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:32.994 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:32.995 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:33.035 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:33.035 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:33.243 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"1_1627314695.258244_277.2","last_update":"2021-07-26T15:51:35.258244Z"},{"marker":"1_1627314695.258244_580.4","last_update":"2021-07-26T15:51:35.258244Z"},{"marker":"1_1627314691.033918_282.3","last_update":"2021-07-26T15:51:31.033918Z"},{"marker":"1_1627314695.258244_548.2","last_update":"2021-07-26T15:51:35.258244Z"}] 2021-07-26T15:54:33.243 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone3 source_zone=test-zone1 2021-07-26T15:54:33.244 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:33.244 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:33.245 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:33.287 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:33.288 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:33.484 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":3487142670906618468},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314695.258244_277.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:51:35.258244Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314695.258244_580.4","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:51:35.258244Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314691.033918_282.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:51:31.033918Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314695.258244_548.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:51:35.258244Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T15:54:33.485 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone3 source_zone=test-zone1 2021-07-26T15:54:33.486 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:33.486 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:33.487 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:33.525 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:33.525 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:33.737 INFO:teuthology.orchestra.run.smithi197.stdout:[{"marker":"1_1627314695.597237_229.4","last_update":"2021-07-26T15:51:35.597237Z"},{"marker":"1_1627314695.597237_553.6","last_update":"2021-07-26T15:51:35.597237Z"},{"marker":"1_1627314695.597237_328.6","last_update":"2021-07-26T15:51:35.597237Z"},{"marker":"1_1627314695.597237_530.6","last_update":"2021-07-26T15:51:35.597237Z"}] 2021-07-26T15:54:33.738 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2021-07-26T15:54:33.738 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:33.739 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:33.739 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:33.781 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:33.781 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:33.988 INFO:teuthology.orchestra.run.smithi183.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":8875080199853872167},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314695.597237_229.4","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:51:35.597237Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314695.597237_553.6","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:51:35.597237Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314695.597237_328.6","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:51:35.597237Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314695.597237_530.6","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:51:35.597237Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T15:54:33.989 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2021-07-26T15:54:33.990 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_sync_disable_enable ... ok 2021-07-26T15:54:33.991 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=mnwbfc-46 2021-07-26T15:54:34.024 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=mnwbfc-47 2021-07-26T15:54:35.683 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-46', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:35.684 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-46', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:35.684 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-46 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:35.725 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:35.726 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:35.907 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000011.87.5"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:54:35.908 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=mnwbfc-46 2021-07-26T15:54:35.909 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-46', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:35.909 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-46', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:35.910 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-46 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:35.958 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:35.959 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:36.176 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000011.87.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:54:36.177 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=mnwbfc-46 2021-07-26T15:54:36.178 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-46', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:36.179 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-46', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:36.180 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-46 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:36.222 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:36.223 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:36.443 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000011.87.5"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:54:36.445 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-46 2021-07-26T15:54:36.446 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-46', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:36.446 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-46', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:36.447 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-46 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:36.493 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:36.494 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:36.727 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000011.87.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:54:36.728 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-46 2021-07-26T15:54:36.729 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-46', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:36.729 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-46', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:36.730 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-46 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:36.770 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:36.771 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:36.967 INFO:teuthology.orchestra.run.smithi197.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000001.69.5"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:54:36.968 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=mnwbfc-46 2021-07-26T15:54:36.968 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'mnwbfc-46', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:36.977 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'mnwbfc-46', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:36.978 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket mnwbfc-46 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:37.023 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:37.024 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:37.241 INFO:teuthology.orchestra.run.smithi183.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"MULTIPART","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.69.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:54:37.242 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=mnwbfc-46 2021-07-26T15:54:37.243 INFO:tasks.rgw_multi.zone_rados:comparing bucket=mnwbfc-46 zones={test-zone2, test-zone1} 2021-07-26T15:54:37.251 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:54:37.299 DEBUG:tasks.rgw_multi.zone_rados:o=MULTIPART 2021-07-26T15:54:37.300 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:54:37.307 DEBUG:tasks.rgw_multi.zone_rados:o=MULTIPART 2021-07-26T15:54:37.362 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=MULTIPART 2021-07-26T15:54:37.594 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=MULTIPART 2021-07-26T15:54:37.896 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=MULTIPART 2021-07-26T15:54:38.175 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=mnwbfc-46 zones={test-zone2, test-zone1} 2021-07-26T15:54:38.177 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_multipart_object_sync ... ok 2021-07-26T15:54:38.179 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=mnwbfc-48 2021-07-26T15:54:38.295 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:38.296 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:38.296 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:38.335 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:38.335 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:38.344 INFO:tasks.rgw.c2.client.0.smithi197.stdout:2021-07-26T15:54:38.340+0000 7fa89aff5700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:54:38.345 INFO:tasks.rgw.c2.client.1.smithi197.stdout:2021-07-26T15:54:38.340+0000 7f4402ffd700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:54:38.345 INFO:tasks.rgw.c2.client.1.smithi197.stdout:2021-07-26T15:54:38.340+0000 7f43f8ff9700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:54:38.346 INFO:tasks.rgw.c2.client.0.smithi197.stdout:2021-07-26T15:54:38.340+0000 7fa89f7fe700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:54:38.347 INFO:tasks.rgw.c2.client.1.smithi197.stdout:2021-07-26T15:54:38.344+0000 7f43f47f0700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:54:38.347 INFO:tasks.rgw.c2.client.1.smithi197.stdout:2021-07-26T15:54:38.344+0000 7f43f47f0700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:54:38.347 INFO:tasks.rgw.c2.client.0.smithi197.stdout:2021-07-26T15:54:38.344+0000 7fa8a4ff9700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:54:38.348 INFO:tasks.rgw.c2.client.0.smithi197.stdout:2021-07-26T15:54:38.344+0000 7fa89b7f6700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:54:38.507 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=816a1f73-b2bd-4f0e-a507-b6c39ba8a110 2021-07-26T15:54:38.525 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314878.204069_457.1","last_update":"2021-07-26T15:54:38.204069Z"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:54:38.525 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:54:38.526 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:38.527 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:38.527 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:38.567 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:38.567 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:38.777 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314878.204069_457.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:54:38.204069Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:54:38.778 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:54:38.778 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:54:38.779 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:38.779 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:38.780 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:38.854 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:38.854 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:39.053 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314878.204069_457.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:54:38.204069Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:54:39.053 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:54:39.054 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-48', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:39.055 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-48', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:39.056 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-48 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:39.099 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:39.100 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:39.314 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000001.42.5"},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000001.48.5"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:54:39.315 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=mnwbfc-48 2021-07-26T15:54:39.316 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-48', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:39.317 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-48', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:39.317 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-48 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:39.365 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:39.365 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:39.579 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"testobj-sse-c","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.42.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"testobj-sse-kms","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.48.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:54:39.580 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=mnwbfc-48 2021-07-26T15:54:39.687 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_encrypted_object_sync ... ok 2021-07-26T15:54:39.688 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=mnwbfc-49 2021-07-26T15:54:39.745 INFO:tasks.rgw.c2.client.1.smithi197.stdout:2021-07-26T15:54:39.740+0000 7f43f5ff3700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:54:39.745 INFO:tasks.rgw.c2.client.0.smithi197.stdout:2021-07-26T15:54:39.740+0000 7fa89e7fc700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:54:39.746 INFO:tasks.rgw.c2.client.1.smithi197.stdout:2021-07-26T15:54:39.744+0000 7f4403fff700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:54:39.747 INFO:tasks.rgw.c2.client.0.smithi197.stdout:2021-07-26T15:54:39.744+0000 7fa89bff7700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:54:39.911 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:39.912 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:39.912 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:39.952 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:39.953 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:40.118 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=816a1f73-b2bd-4f0e-a507-b6c39ba8a110 2021-07-26T15:54:40.140 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314879.711539_461.1","last_update":"2021-07-26T15:54:39.711539Z"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:54:40.141 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:54:40.142 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:40.142 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:40.143 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:40.181 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:40.181 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:40.383 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314879.711539_461.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:54:39.711539Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:54:40.384 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:54:40.384 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:54:40.385 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:40.385 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:40.386 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:40.427 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:40.427 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:40.620 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314879.711539_461.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:54:39.711539Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:54:40.621 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:54:40.622 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-49', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:40.623 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-49', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:40.624 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-49 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:40.665 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:40.666 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:40.878 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000001.39.5"},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000001.48.5"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000001.30.5"},{"key":9,"val":""},{"key":10,"val":"00000000001.48.5"}]} 2021-07-26T15:54:40.879 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=mnwbfc-49 2021-07-26T15:54:40.880 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-49', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:40.881 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-49', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:40.882 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-49 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:40.929 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:40.931 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:41.149 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"a","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.39.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"d","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.48.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"c","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.30.5"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"b","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.48.5"}}}] 2021-07-26T15:54:41.150 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=mnwbfc-49 2021-07-26T15:54:41.150 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-49', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:41.151 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-49', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:41.152 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-49 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:41.191 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:41.192 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:41.400 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000001.39.5"},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000001.48.5"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000001.30.5"},{"key":9,"val":""},{"key":10,"val":"00000000001.48.5"}]} 2021-07-26T15:54:41.400 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-49 2021-07-26T15:54:41.401 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-49', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:41.401 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-49', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:41.402 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-49 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:41.448 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:41.448 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:41.660 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.39.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.48.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.30.5"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.48.5"}}}] 2021-07-26T15:54:41.661 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-49 2021-07-26T15:54:41.661 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-49', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:41.662 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-49', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:41.663 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-49 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:41.703 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:41.703 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:41.895 INFO:teuthology.orchestra.run.smithi197.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000001.46.5"},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000001.50.5"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000001.46.5"},{"key":9,"val":""},{"key":10,"val":"00000000001.59.5"}]} 2021-07-26T15:54:41.896 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=mnwbfc-49 2021-07-26T15:54:41.896 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'mnwbfc-49', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:41.897 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'mnwbfc-49', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:41.897 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket mnwbfc-49 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:41.942 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:41.942 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:42.168 INFO:teuthology.orchestra.run.smithi183.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"a","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.46.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"d","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.50.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"c","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.46.5"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"b","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.59.5"}}}] 2021-07-26T15:54:42.169 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=mnwbfc-49 2021-07-26T15:54:42.170 INFO:tasks.rgw_multi.zone_rados:comparing bucket=mnwbfc-49 zones={test-zone2, test-zone1} 2021-07-26T15:54:42.179 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:54:42.184 DEBUG:tasks.rgw_multi.zone_rados:o=a 2021-07-26T15:54:42.185 DEBUG:tasks.rgw_multi.zone_rados:o=b 2021-07-26T15:54:42.186 DEBUG:tasks.rgw_multi.zone_rados:o=c 2021-07-26T15:54:42.186 DEBUG:tasks.rgw_multi.zone_rados:o=d 2021-07-26T15:54:42.187 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:54:42.191 DEBUG:tasks.rgw_multi.zone_rados:o=a 2021-07-26T15:54:42.192 DEBUG:tasks.rgw_multi.zone_rados:o=b 2021-07-26T15:54:42.192 DEBUG:tasks.rgw_multi.zone_rados:o=c 2021-07-26T15:54:42.193 DEBUG:tasks.rgw_multi.zone_rados:o=d 2021-07-26T15:54:42.244 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2021-07-26T15:54:42.302 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2021-07-26T15:54:42.413 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2021-07-26T15:54:42.520 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2021-07-26T15:54:42.577 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2021-07-26T15:54:42.692 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2021-07-26T15:54:42.801 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2021-07-26T15:54:42.856 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2021-07-26T15:54:42.961 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2021-07-26T15:54:43.064 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2021-07-26T15:54:43.121 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2021-07-26T15:54:43.226 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2021-07-26T15:54:43.328 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=mnwbfc-49 zones={test-zone2, test-zone1} 2021-07-26T15:54:43.329 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'autotrim', '--rgw-sync-log-trim-max-buckets', '0', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:54:43.330 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'autotrim', '--rgw-sync-log-trim-max-buckets', '0', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:54:43.330 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog autotrim --rgw-sync-log-trim-max-buckets 0 --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:54:43.365 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:43.366 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:43.583 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=mnwbfc-50 2021-07-26T15:54:43.747 INFO:tasks.rgw.c2.client.1.smithi197.stdout:2021-07-26T15:54:43.744+0000 7f43fbfff700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:54:43.748 INFO:tasks.rgw.c2.client.0.smithi197.stdout:2021-07-26T15:54:43.744+0000 7fa8a5ffb700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:54:43.748 INFO:tasks.rgw.c2.client.1.smithi197.stdout:2021-07-26T15:54:43.744+0000 7f43f87f8700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:54:43.749 INFO:tasks.rgw.c2.client.0.smithi197.stdout:2021-07-26T15:54:43.744+0000 7fa8b2ffd700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:54:43.749 INFO:tasks.rgw.c2.client.0.smithi197.stdout:2021-07-26T15:54:43.744+0000 7fa8967ec700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:54:43.750 INFO:tasks.rgw.c2.client.1.smithi197.stdout:2021-07-26T15:54:43.744+0000 7f43f97fa700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:54:43.750 INFO:tasks.rgw.c2.client.0.smithi197.stdout:2021-07-26T15:54:43.744+0000 7fa897fef700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:54:43.750 INFO:tasks.rgw.c2.client.1.smithi197.stdout:2021-07-26T15:54:43.744+0000 7f440dffb700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:54:43.751 INFO:tasks.rgw.c2.client.1.smithi197.stdout:2021-07-26T15:54:43.744+0000 7f43fb7fe700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:54:43.751 INFO:tasks.rgw.c2.client.0.smithi197.stdout:2021-07-26T15:54:43.748+0000 7fa89dffb700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:54:43.752 INFO:tasks.rgw.c2.client.0.smithi197.stdout:2021-07-26T15:54:43.748+0000 7fa89a7f4700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:54:43.752 INFO:tasks.rgw.c2.client.1.smithi197.stdout:2021-07-26T15:54:43.748+0000 7f440cff9700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:54:43.814 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:43.814 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:43.815 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:43.850 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:43.850 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:43.996 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=816a1f73-b2bd-4f0e-a507-b6c39ba8a110 2021-07-26T15:54:44.025 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314883.607417_465.1","last_update":"2021-07-26T15:54:43.607417Z"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:54:44.025 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:54:44.028 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:44.029 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:44.029 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:44.074 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:44.075 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:44.262 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314883.607417_465.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:54:43.607417Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:54:44.263 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:54:44.263 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:54:44.264 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:44.264 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:44.265 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:44.303 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:44.304 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:44.495 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314883.607417_465.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:54:43.607417Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:54:44.496 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:54:44.497 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-50', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:44.497 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-50', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:44.498 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-50 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:44.539 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:44.539 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:44.739 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000001.52.5"},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000001.44.5"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000001.23.5"},{"key":9,"val":""},{"key":10,"val":"00000000001.52.5"}]} 2021-07-26T15:54:44.739 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=mnwbfc-50 2021-07-26T15:54:44.740 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-50', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:44.740 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-50', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:44.741 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-50 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:44.785 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:44.787 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:44.997 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"a","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.52.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"d","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.44.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"c","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.23.5"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"b","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.52.5"}}}] 2021-07-26T15:54:44.997 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=mnwbfc-50 2021-07-26T15:54:44.998 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-50', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:44.998 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-50', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:44.999 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-50 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:45.042 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:45.043 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:45.245 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000001.52.5"},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000001.44.5"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000001.23.5"},{"key":9,"val":""},{"key":10,"val":"00000000001.52.5"}]} 2021-07-26T15:54:45.245 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-50 2021-07-26T15:54:45.246 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-50', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:45.246 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-50', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:45.247 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-50 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:45.291 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:45.292 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:45.502 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.52.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.44.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.23.5"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.52.5"}}}] 2021-07-26T15:54:45.503 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-50 2021-07-26T15:54:45.504 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-50', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:45.504 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-50', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:45.505 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-50 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:45.544 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:45.544 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:45.747 INFO:teuthology.orchestra.run.smithi197.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000001.65.5"},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000001.73.5"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000001.35.5"},{"key":9,"val":""},{"key":10,"val":"00000000001.75.5"}]} 2021-07-26T15:54:45.748 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=mnwbfc-50 2021-07-26T15:54:45.748 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'mnwbfc-50', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:45.749 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'mnwbfc-50', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:45.750 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket mnwbfc-50 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:45.795 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:45.795 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:46.015 INFO:teuthology.orchestra.run.smithi183.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"a","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.65.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"d","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.73.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"c","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.35.5"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"b","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.75.5"}}}] 2021-07-26T15:54:46.016 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=mnwbfc-50 2021-07-26T15:54:46.016 INFO:tasks.rgw_multi.zone_rados:comparing bucket=mnwbfc-50 zones={test-zone2, test-zone1} 2021-07-26T15:54:46.025 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:54:46.030 DEBUG:tasks.rgw_multi.zone_rados:o=a 2021-07-26T15:54:46.030 DEBUG:tasks.rgw_multi.zone_rados:o=b 2021-07-26T15:54:46.031 DEBUG:tasks.rgw_multi.zone_rados:o=c 2021-07-26T15:54:46.031 DEBUG:tasks.rgw_multi.zone_rados:o=d 2021-07-26T15:54:46.032 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:54:46.079 DEBUG:tasks.rgw_multi.zone_rados:o=a 2021-07-26T15:54:46.080 DEBUG:tasks.rgw_multi.zone_rados:o=b 2021-07-26T15:54:46.081 DEBUG:tasks.rgw_multi.zone_rados:o=c 2021-07-26T15:54:46.081 DEBUG:tasks.rgw_multi.zone_rados:o=d 2021-07-26T15:54:46.135 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2021-07-26T15:54:46.194 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2021-07-26T15:54:46.306 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2021-07-26T15:54:46.410 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2021-07-26T15:54:46.465 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2021-07-26T15:54:46.571 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2021-07-26T15:54:46.677 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2021-07-26T15:54:46.732 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2021-07-26T15:54:46.844 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2021-07-26T15:54:46.949 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2021-07-26T15:54:47.003 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2021-07-26T15:54:47.114 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2021-07-26T15:54:47.215 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=mnwbfc-50 zones={test-zone2, test-zone1} 2021-07-26T15:54:47.216 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'autotrim', '--rgw-sync-log-trim-max-buckets', '1', '--rgw-sync-log-trim-min-cold-buckets', '0', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:54:47.216 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'autotrim', '--rgw-sync-log-trim-max-buckets', '1', '--rgw-sync-log-trim-min-cold-buckets', '0', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:54:47.218 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog autotrim --rgw-sync-log-trim-max-buckets 1 --rgw-sync-log-trim-min-cold-buckets 0 --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:54:47.255 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:47.256 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:47.482 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'list', '--bucket', 'mnwbfc-50', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:47.483 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'list', '--bucket', 'mnwbfc-50', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:47.484 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog list --bucket mnwbfc-50 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:47.520 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:47.521 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:47.720 INFO:teuthology.orchestra.run.smithi183.stdout:[] 2021-07-26T15:54:47.721 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'list', '--bucket', 'mnwbfc-49', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:47.721 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'list', '--bucket', 'mnwbfc-49', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:47.722 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog list --bucket mnwbfc-49 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:47.758 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:47.758 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:47.967 INFO:teuthology.orchestra.run.smithi183.stdout:[{"op_id":"1#00000000001.39.5","op_tag":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4937.2029","op":"write","object":"a","instance":"","state":"complete","index_ver":1,"timestamp":"2021-07-26T15:54:39.719247518Z","ver":{"pool":9,"epoch":3},"bilog_flags":0,"versioned":false,"owner":"","owner_display_name":"","zones_trace":[{"entry":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe:mnwbfc-49:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4939.14"}]},{"op_id":"5#00000000001.48.5","op_tag":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4937.2056","op":"write","object":"d","instance":"","state":"complete","index_ver":1,"timestamp":"2021-07-26T15:54:39.869138227Z","ver":{"pool":9,"epoch":1},"bilog_flags":0,"versioned":false,"owner":"","owner_display_name":"","zones_trace":[{"entry":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe:mnwbfc-49:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4939.14"}]},{"op_id":"8#00000000001.30.5","op_tag":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4937.2050","op":"write","object":"c","instance":"","state":"complete","index_ver":1,"timestamp":"2021-07-26T15:54:39.820166878Z","ver":{"pool":9,"epoch":1},"bilog_flags":0,"versioned":false,"owner":"","owner_display_name":"","zones_trace":[{"entry":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe:mnwbfc-49:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4939.14"}]},{"op_id":"10#00000000001.48.5","op_tag":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4937.2039","op":"write","object":"b","instance":"","state":"complete","index_ver":1,"timestamp":"2021-07-26T15:54:39.773246969Z","ver":{"pool":9,"epoch":2},"bilog_flags":0,"versioned":false,"owner":"","owner_display_name":"","zones_trace":[{"entry":"fdbd535a-3fb6-49cb-8b49-68faf14e40fe:mnwbfc-49:fdbd535a-3fb6-49cb-8b49-68faf14e40fe.4939.14"}]}] 2021-07-26T15:54:47.968 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'autotrim', '--rgw-sync-log-trim-max-buckets', '999', '--rgw-sync-log-trim-min-cold-buckets', '999', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:54:47.969 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'autotrim', '--rgw-sync-log-trim-max-buckets', '999', '--rgw-sync-log-trim-min-cold-buckets', '999', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:54:47.969 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog autotrim --rgw-sync-log-trim-max-buckets 999 --rgw-sync-log-trim-min-cold-buckets 999 --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:54:48.044 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:48.045 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:48.781 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'list', '--bucket', 'mnwbfc-49', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:48.782 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'list', '--bucket', 'mnwbfc-49', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:48.783 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog list --bucket mnwbfc-49 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:48.820 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:48.821 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:49.032 INFO:teuthology.orchestra.run.smithi183.stdout:[] 2021-07-26T15:54:49.033 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_index_log_trim ... ok 2021-07-26T15:54:49.046 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_creation_time ... ok 2021-07-26T15:54:49.047 INFO:tasks.rgw_multisite_tests:log information for manual testing ... ok 2021-07-26T15:54:49.047 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:49.049 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:49.050 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:49.087 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:49.087 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:49.259 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=816a1f73-b2bd-4f0e-a507-b6c39ba8a110 2021-07-26T15:54:49.291 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314883.607417_465.1","last_update":"2021-07-26T15:54:43.607417Z"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:54:49.292 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:54:49.292 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:49.293 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:49.294 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:49.334 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:49.335 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:49.529 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314883.607417_465.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:54:43.607417Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:54:49.530 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:54:49.530 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:54:49.531 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:49.531 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:49.532 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:49.571 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:49.571 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:49.769 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314883.607417_465.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:54:43.607417Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:54:49.770 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:54:49.771 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:49.771 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:49.772 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:49.812 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:49.813 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:49.983 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=816a1f73-b2bd-4f0e-a507-b6c39ba8a110 2021-07-26T15:54:50.015 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314883.607417_465.1","last_update":"2021-07-26T15:54:43.607417Z"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:54:50.015 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:54:50.016 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:50.016 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:50.017 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:50.057 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:50.058 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:50.242 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314883.607417_465.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:54:43.607417Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:54:50.243 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:54:50.272 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:50.272 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:50.273 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:50.310 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:50.310 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:50.476 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=816a1f73-b2bd-4f0e-a507-b6c39ba8a110 2021-07-26T15:54:50.509 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314890.267477_469.1","last_update":"2021-07-26T15:54:50.267477Z"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:54:50.510 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:54:50.510 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:50.511 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:50.512 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:50.552 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:50.552 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:50.741 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314890.267477_469.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:54:50.267477Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:54:50.741 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:54:50.995 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:50.996 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:50.997 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:51.037 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:51.037 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:51.213 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=816a1f73-b2bd-4f0e-a507-b6c39ba8a110 2021-07-26T15:54:51.245 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314890.267477_469.1","last_update":"2021-07-26T15:54:50.267477Z"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:54:51.246 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:54:51.246 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:51.247 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:51.247 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:51.288 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:51.288 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:51.478 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314890.267477_469.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:54:50.267477Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:54:51.481 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:54:51.553 INFO:tasks.rgw_multisite_tests:test low level implementation of s3 notifications ... ok 2021-07-26T15:54:51.553 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:51.554 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:51.555 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:51.593 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:51.594 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:51.766 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=816a1f73-b2bd-4f0e-a507-b6c39ba8a110 2021-07-26T15:54:51.796 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314891.547533_471.1","last_update":"2021-07-26T15:54:51.547533Z"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:54:51.797 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:54:51.797 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:51.798 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:51.798 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:51.840 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:51.840 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:52.043 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314891.547533_471.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:54:51.547533Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:54:52.044 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:54:52.044 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:54:52.045 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:52.045 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:52.046 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:52.084 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:52.084 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:52.276 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314891.547533_471.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:54:51.547533Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:54:52.277 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:54:52.278 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:52.278 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:52.279 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:52.319 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:52.319 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:52.488 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=816a1f73-b2bd-4f0e-a507-b6c39ba8a110 2021-07-26T15:54:52.511 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314891.547533_471.1","last_update":"2021-07-26T15:54:51.547533Z"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:54:52.512 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:54:52.512 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:52.513 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:52.513 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:52.555 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:52.556 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:52.748 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314891.547533_471.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:54:51.547533Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:54:52.749 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:54:52.779 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:52.779 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:52.780 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:52.819 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:52.819 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:52.996 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=816a1f73-b2bd-4f0e-a507-b6c39ba8a110 2021-07-26T15:54:53.031 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314892.773367_475.1","last_update":"2021-07-26T15:54:52.773367Z"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:54:53.032 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:54:53.032 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:53.033 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:53.033 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:53.076 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:53.077 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:53.279 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314892.773367_475.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:54:52.773367Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:54:53.280 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:54:53.319 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:53.319 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:53.320 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:53.365 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:53.365 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:53.540 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=816a1f73-b2bd-4f0e-a507-b6c39ba8a110 2021-07-26T15:54:53.572 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314892.773367_475.1","last_update":"2021-07-26T15:54:52.773367Z"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:54:53.573 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:54:53.573 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:53.574 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:53.575 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:53.614 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:53.614 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:53.804 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314892.773367_475.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:54:52.773367Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:54:53.805 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:54:54.219 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-52', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:54.220 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-52', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:54.220 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-52 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:54.263 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:54.264 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:54.431 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000002.72.5"},{"key":2,"val":""},{"key":3,"val":"00000000001.53.5"},{"key":4,"val":"00000000001.79.5"},{"key":5,"val":"00000000001.40.5"},{"key":6,"val":""},{"key":7,"val":"00000000001.69.5"},{"key":8,"val":"00000000001.79.5"},{"key":9,"val":"00000000001.77.5"},{"key":10,"val":"00000000002.73.5"}]} 2021-07-26T15:54:54.431 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-52 2021-07-26T15:54:54.432 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-52', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:54.432 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-52', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:54.433 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-52 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:54.480 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:54.481 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:54.682 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.72.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.53.5"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.79.5"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.40.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.69.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.79.5"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.77.5"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.73.5"}}}] 2021-07-26T15:54:54.683 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-52 2021-07-26T15:54:54.696 WARNING:rgw_multi.tests_ps:superfluous records are found 2021-07-26T15:54:54.812 INFO:tasks.rgw_multisite_tests:test s3 records fetching ... ok 2021-07-26T15:54:54.813 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:54.814 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:54.814 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:54.853 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:54.853 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:55.004 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=816a1f73-b2bd-4f0e-a507-b6c39ba8a110 2021-07-26T15:54:55.034 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314894.807051_477.1","last_update":"2021-07-26T15:54:54.807051Z"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:54:55.035 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:54:55.035 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:55.036 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:55.037 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:55.077 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:55.077 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:55.279 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314894.807051_477.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:54:54.807051Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:54:55.280 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:54:55.280 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:54:55.281 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:55.281 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:55.282 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:55.325 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:55.326 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:55.518 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314894.807051_477.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:54:54.807051Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:54:55.519 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:54:55.519 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:55.521 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:55.522 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:55.562 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:55.564 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:55.738 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=816a1f73-b2bd-4f0e-a507-b6c39ba8a110 2021-07-26T15:54:55.770 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314894.807051_477.1","last_update":"2021-07-26T15:54:54.807051Z"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:54:55.770 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:54:55.771 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:55.772 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:55.773 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:55.814 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:55.815 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:56.003 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314894.807051_477.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:54:54.807051Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:54:56.004 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:54:56.032 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:56.033 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:56.033 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:56.068 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:56.069 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:56.236 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=816a1f73-b2bd-4f0e-a507-b6c39ba8a110 2021-07-26T15:54:56.266 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314896.028096_481.1","last_update":"2021-07-26T15:54:56.028096Z"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:54:56.267 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:54:56.273 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:56.273 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:56.274 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:56.310 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:56.310 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:56.502 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314896.028096_481.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:54:56.028096Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:54:56.503 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:54:56.571 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:56.571 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:56.572 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:56.611 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:56.612 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:56.784 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=816a1f73-b2bd-4f0e-a507-b6c39ba8a110 2021-07-26T15:54:56.815 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314896.028096_481.1","last_update":"2021-07-26T15:54:56.028096Z"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:54:56.815 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:54:56.816 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:56.816 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:56.817 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:56.853 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:56.853 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:57.049 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314896.028096_481.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:54:56.028096Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:54:57.050 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:54:57.132 INFO:tasks.rgw_multisite_tests:test s3 notification set/get/delete ... ok 2021-07-26T15:54:57.133 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:57.134 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:57.135 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:57.171 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:57.171 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:57.345 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=816a1f73-b2bd-4f0e-a507-b6c39ba8a110 2021-07-26T15:54:57.378 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314897.126573_483.1","last_update":"2021-07-26T15:54:57.126573Z"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:54:57.379 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:54:57.380 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:57.381 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:57.381 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:57.421 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:57.421 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:57.626 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314897.126573_483.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:54:57.126573Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:54:57.627 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:54:57.629 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:54:57.629 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:57.630 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:57.630 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:57.669 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:57.669 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:57.851 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314897.126573_483.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:54:57.126573Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:54:57.852 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:54:57.852 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:57.853 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:57.854 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:57.892 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:57.893 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:58.066 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=816a1f73-b2bd-4f0e-a507-b6c39ba8a110 2021-07-26T15:54:58.097 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314897.126573_483.1","last_update":"2021-07-26T15:54:57.126573Z"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:54:58.097 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:54:58.098 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:58.098 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:58.099 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:58.137 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:58.138 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:58.336 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314897.126573_483.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:54:57.126573Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:54:58.337 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:54:58.630 INFO:tasks.rgw_multisite_tests:test s3 topics set/get/delete on master ... ok 2021-07-26T15:54:58.630 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:58.631 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:58.633 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:58.673 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:58.674 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:58.847 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=816a1f73-b2bd-4f0e-a507-b6c39ba8a110 2021-07-26T15:54:58.879 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314897.126573_483.1","last_update":"2021-07-26T15:54:57.126573Z"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:54:58.880 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:54:58.880 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:58.881 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:58.882 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:58.926 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:58.927 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:59.131 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314897.126573_483.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:54:57.126573Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:54:59.131 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:54:59.132 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:54:59.132 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:59.133 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:59.134 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:59.172 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:59.172 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:59.373 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314897.126573_483.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:54:57.126573Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:54:59.374 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:54:59.375 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:59.375 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:59.376 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:59.417 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:59.418 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:59.593 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=816a1f73-b2bd-4f0e-a507-b6c39ba8a110 2021-07-26T15:54:59.626 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314897.126573_483.1","last_update":"2021-07-26T15:54:57.126573Z"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:54:59.626 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:54:59.627 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:59.628 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:59.628 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:59.671 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:59.671 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:59.862 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314897.126573_483.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:54:57.126573Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:54:59.862 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:54:59.863 INFO:tasks.rgw_multisite_tests:test s3 topics with secret set/get/delete on master ... ok 2021-07-26T15:54:59.865 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:59.866 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:59.867 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:59.907 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:59.908 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:00.075 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=816a1f73-b2bd-4f0e-a507-b6c39ba8a110 2021-07-26T15:55:00.104 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314897.126573_483.1","last_update":"2021-07-26T15:54:57.126573Z"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:55:00.104 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:55:00.105 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:00.106 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:00.106 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:00.146 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:00.147 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:00.349 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314897.126573_483.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:54:57.126573Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:55:00.349 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:55:00.350 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:55:00.350 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:00.351 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:00.351 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:00.430 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:00.431 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:00.632 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314897.126573_483.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:54:57.126573Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:55:00.633 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:55:00.634 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:00.634 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:00.635 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:00.674 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:00.675 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:00.847 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=816a1f73-b2bd-4f0e-a507-b6c39ba8a110 2021-07-26T15:55:00.879 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314897.126573_483.1","last_update":"2021-07-26T15:54:57.126573Z"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:55:00.880 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:55:00.881 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:00.881 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:00.882 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:00.923 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:00.923 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:01.119 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314897.126573_483.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:54:57.126573Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:55:01.120 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:55:01.381 INFO:tasks.rgw_multisite_tests:test s3 notification set/get/delete on master ... ok 2021-07-26T15:55:01.383 INFO:tasks.rgw_multisite_tests:rgw_multi.tests_ps.test_ps_s3_notification_filter_on_master ... ok 2021-07-26T15:55:01.383 INFO:tasks.rgw_multisite_tests:rgw_multi.tests_ps.test_ps_s3_notification_filter ... ok 2021-07-26T15:55:01.384 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:01.385 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:01.385 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:01.424 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:01.425 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:01.600 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=816a1f73-b2bd-4f0e-a507-b6c39ba8a110 2021-07-26T15:55:01.629 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314901.375402_489.1","last_update":"2021-07-26T15:55:01.375402Z"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:55:01.629 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:55:01.630 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:01.631 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:01.631 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:01.670 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:01.670 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:01.864 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314901.375402_489.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:01.375402Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:55:01.865 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:55:01.865 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:55:01.866 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:01.866 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:01.867 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:01.903 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:01.903 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:02.099 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314901.375402_489.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:01.375402Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:55:02.100 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:55:02.101 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:02.101 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:02.102 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:02.142 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:02.143 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:02.319 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=816a1f73-b2bd-4f0e-a507-b6c39ba8a110 2021-07-26T15:55:02.350 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314901.375402_489.1","last_update":"2021-07-26T15:55:01.375402Z"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:55:02.350 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:55:02.351 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:02.351 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:02.352 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:02.390 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:02.390 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:02.591 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314901.375402_489.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:01.375402Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:55:02.592 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:55:02.802 INFO:tasks.rgw_multisite_tests:test s3 notification set/get/delete on master ... ok 2021-07-26T15:55:02.803 INFO:tasks.rgw_multisite_tests:rgw_multi.tests_ps.test_objcet_timing ... ok 2021-07-26T15:55:02.804 INFO:tasks.rgw_multisite_tests:test pushing amqp s3 notification on master ... ok 2021-07-26T15:55:02.805 INFO:tasks.rgw_multisite_tests:test pushing kafka s3 notification on master ... ok 2021-07-26T15:55:02.806 INFO:tasks.rgw_multisite_tests:test pushing kafka s3 notification on master ... ok 2021-07-26T15:55:02.807 INFO:tasks.rgw_multisite_tests:rgw_multi.tests_ps.test_ps_s3_notification_push_kafka_security_ssl ... ok 2021-07-26T15:55:02.808 INFO:tasks.rgw_multisite_tests:rgw_multi.tests_ps.test_ps_s3_notification_push_kafka_security_ssl_sasl ... ok 2021-07-26T15:55:02.808 INFO:tasks.rgw_multisite_tests:test deletion of multiple keys on master ... ok 2021-07-26T15:55:02.809 INFO:tasks.rgw_multisite_tests:test pushing http s3 notification on master ... ok 2021-07-26T15:55:02.811 INFO:tasks.rgw_multisite_tests:test that opaque id set in topic, is sent in notification ... ok 2021-07-26T15:55:02.811 INFO:tasks.rgw_multisite_tests:test that opaque id set in topic, is sent in notification on master ... ok 2021-07-26T15:55:02.812 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:02.812 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:02.813 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:02.852 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:02.853 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:03.027 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=816a1f73-b2bd-4f0e-a507-b6c39ba8a110 2021-07-26T15:55:03.060 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314902.796959_495.1","last_update":"2021-07-26T15:55:02.796959Z"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:55:03.061 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:55:03.061 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:03.062 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:03.063 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:03.104 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:03.104 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:03.311 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314902.796959_495.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:02.796959Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:55:03.312 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:55:03.312 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:55:03.313 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:03.313 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:03.314 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:03.355 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:03.355 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:03.557 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314902.796959_495.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:02.796959Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:55:03.558 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:55:03.559 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:03.560 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:03.561 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:03.601 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:03.602 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:03.777 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=816a1f73-b2bd-4f0e-a507-b6c39ba8a110 2021-07-26T15:55:03.808 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314902.796959_495.1","last_update":"2021-07-26T15:55:02.796959Z"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:55:03.809 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:55:03.809 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:03.810 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:03.811 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:03.852 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:03.852 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:04.043 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314902.796959_495.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:02.796959Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:55:04.043 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:55:04.062 INFO:tasks.rgw_multisite_tests:test set/get/delete of topic ... ok 2021-07-26T15:55:04.063 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:04.063 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:04.064 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:04.104 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:04.105 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:04.278 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=816a1f73-b2bd-4f0e-a507-b6c39ba8a110 2021-07-26T15:55:04.308 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314902.796959_495.1","last_update":"2021-07-26T15:55:02.796959Z"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:55:04.309 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:55:04.309 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:04.310 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:04.311 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:04.350 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:04.351 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:04.566 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314902.796959_495.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:02.796959Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:55:04.567 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:55:04.568 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:55:04.568 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:04.569 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:04.569 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:04.608 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:04.608 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:04.810 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314902.796959_495.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:02.796959Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:55:04.811 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:55:04.812 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:04.812 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:04.813 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:04.853 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:04.854 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:05.037 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=816a1f73-b2bd-4f0e-a507-b6c39ba8a110 2021-07-26T15:55:05.070 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314902.796959_495.1","last_update":"2021-07-26T15:55:02.796959Z"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:55:05.070 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:55:05.071 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:05.071 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:05.072 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:05.113 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:05.113 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:05.322 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314902.796959_495.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:02.796959Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:55:05.323 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:55:05.340 INFO:tasks.rgw_multisite_tests:test set topic with endpoint ... ok 2021-07-26T15:55:05.341 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:05.342 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:05.342 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:05.381 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:05.381 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:05.554 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=816a1f73-b2bd-4f0e-a507-b6c39ba8a110 2021-07-26T15:55:05.587 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314902.796959_495.1","last_update":"2021-07-26T15:55:02.796959Z"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:55:05.588 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:55:05.589 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:05.589 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:05.590 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:05.629 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:05.630 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:05.832 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314902.796959_495.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:02.796959Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:55:05.833 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:55:05.833 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:55:05.834 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:05.834 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:05.835 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:05.914 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:05.915 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:06.106 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314902.796959_495.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:02.796959Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:55:06.106 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:55:06.107 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:06.108 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:06.108 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:06.147 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:06.147 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:06.342 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=816a1f73-b2bd-4f0e-a507-b6c39ba8a110 2021-07-26T15:55:06.375 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314902.796959_495.1","last_update":"2021-07-26T15:55:02.796959Z"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:55:06.376 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:55:06.376 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:06.377 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:06.378 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:06.418 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:06.418 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:06.623 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314902.796959_495.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:02.796959Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:55:06.624 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:55:06.658 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:06.658 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:06.659 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:06.694 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:06.695 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:06.884 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=816a1f73-b2bd-4f0e-a507-b6c39ba8a110 2021-07-26T15:55:06.916 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314906.653344_499.1","last_update":"2021-07-26T15:55:06.653344Z"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:55:06.917 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:55:06.917 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:06.918 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:06.918 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:06.957 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:06.958 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:07.164 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314906.653344_499.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:06.653344Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:55:07.164 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:55:07.219 INFO:tasks.rgw_multisite_tests:test set/get/delete of notification ... ok 2021-07-26T15:55:07.219 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:07.220 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:07.220 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:07.260 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:07.260 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:07.460 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=816a1f73-b2bd-4f0e-a507-b6c39ba8a110 2021-07-26T15:55:07.492 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314907.213596_501.1","last_update":"2021-07-26T15:55:07.213596Z"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:55:07.492 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:55:07.493 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:07.493 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:07.494 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:07.534 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:07.534 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:07.765 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314907.213596_501.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:07.213596Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:55:07.766 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:55:07.767 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:55:07.767 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:07.768 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:07.768 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:07.852 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:07.853 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:08.054 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314907.213596_501.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:07.213596Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:55:08.054 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:55:08.055 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:08.055 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:08.056 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:08.096 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:08.096 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:08.290 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=816a1f73-b2bd-4f0e-a507-b6c39ba8a110 2021-07-26T15:55:08.326 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314907.213596_501.1","last_update":"2021-07-26T15:55:07.213596Z"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:55:08.327 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:55:08.327 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:08.328 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:08.328 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:08.369 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:08.369 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:08.576 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314907.213596_501.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:07.213596Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:55:08.576 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:55:08.612 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:08.613 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:08.614 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:08.650 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:08.651 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:08.832 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=816a1f73-b2bd-4f0e-a507-b6c39ba8a110 2021-07-26T15:55:08.866 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314908.607316_505.1","last_update":"2021-07-26T15:55:08.607316Z"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:55:08.867 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:55:08.867 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:08.868 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:08.868 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:08.910 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:08.910 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:09.124 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314908.607316_505.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:08.607316Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:55:09.124 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:55:09.197 INFO:tasks.rgw_multisite_tests:test set/get/delete of notification on specific events ... ok 2021-07-26T15:55:09.198 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:09.199 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:09.199 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:09.237 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:09.237 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:09.426 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=816a1f73-b2bd-4f0e-a507-b6c39ba8a110 2021-07-26T15:55:09.461 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314909.190053_507.1","last_update":"2021-07-26T15:55:09.190053Z"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:55:09.461 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:55:09.462 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:09.462 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:09.465 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:09.506 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:09.507 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:09.721 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314909.190053_507.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:09.190053Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:55:09.722 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:55:09.722 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:55:09.723 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:09.723 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:09.724 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:09.763 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:09.763 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:09.963 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314909.190053_507.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:09.190053Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:55:09.964 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:55:09.964 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:09.965 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:09.965 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:10.007 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:10.007 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:10.193 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=816a1f73-b2bd-4f0e-a507-b6c39ba8a110 2021-07-26T15:55:10.226 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314909.190053_507.1","last_update":"2021-07-26T15:55:09.190053Z"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:55:10.227 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:55:10.227 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:10.232 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:10.233 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:10.275 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:10.276 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:10.470 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314909.190053_507.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:09.190053Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:55:10.471 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:55:10.511 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:10.511 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:10.512 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:10.546 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:10.546 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:10.734 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=816a1f73-b2bd-4f0e-a507-b6c39ba8a110 2021-07-26T15:55:10.765 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314910.506910_511.1","last_update":"2021-07-26T15:55:10.506910Z"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:55:10.766 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:55:10.767 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:10.767 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:10.768 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:10.810 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:10.815 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:10.996 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314910.506910_511.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:10.506910Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:55:10.997 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:55:11.431 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-61', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:11.432 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-61', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:11.433 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-61 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:11.480 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:11.481 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:11.670 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000002.49.5"},{"key":2,"val":""},{"key":3,"val":"00000000001.152.5"},{"key":4,"val":"00000000001.59.5"},{"key":5,"val":"00000000001.61.5"},{"key":6,"val":""},{"key":7,"val":"00000000001.76.5"},{"key":8,"val":"00000000001.66.5"},{"key":9,"val":"00000000001.69.5"},{"key":10,"val":"00000000002.58.5"}]} 2021-07-26T15:55:11.671 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-61 2021-07-26T15:55:11.672 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-61', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:11.672 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-61', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:11.673 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-61 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:11.717 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:11.717 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:11.929 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.49.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.152.5"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.59.5"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.61.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.76.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.66.5"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.69.5"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.58.5"}}}] 2021-07-26T15:55:11.929 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-61 2021-07-26T15:55:12.068 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-61', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:12.069 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-61', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:12.070 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-61 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:12.113 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:12.114 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:12.318 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000004.53.5"},{"key":2,"val":""},{"key":3,"val":"00000000002.154.5"},{"key":4,"val":"00000000002.61.5"},{"key":5,"val":"00000000002.63.5"},{"key":6,"val":""},{"key":7,"val":"00000000002.78.5"},{"key":8,"val":"00000000002.68.5"},{"key":9,"val":"00000000002.71.5"},{"key":10,"val":"00000000004.62.5"}]} 2021-07-26T15:55:12.319 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-61 2021-07-26T15:55:12.320 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-61', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:12.320 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-61', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:12.321 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-61 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:12.365 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:12.366 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:12.587 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.53.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.154.5"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.61.5"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.63.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.78.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.68.5"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.71.5"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.62.5"}}}] 2021-07-26T15:55:12.587 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-61 2021-07-26T15:55:12.646 INFO:tasks.rgw_multisite_tests:test set/get/delete of subscription ... ok 2021-07-26T15:55:12.647 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:12.648 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:12.648 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:12.684 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:12.684 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:12.879 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=816a1f73-b2bd-4f0e-a507-b6c39ba8a110 2021-07-26T15:55:12.911 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314912.640404_513.1","last_update":"2021-07-26T15:55:12.640404Z"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:55:12.911 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:55:12.912 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:12.913 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:12.913 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:12.953 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:12.953 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:13.168 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314912.640404_513.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:12.640404Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:55:13.168 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:55:13.169 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:55:13.169 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:13.170 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:13.170 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:13.213 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:13.213 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:13.421 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314912.640404_513.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:12.640404Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:55:13.422 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:55:13.422 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:13.423 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:13.424 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:13.471 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:13.472 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:13.657 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=816a1f73-b2bd-4f0e-a507-b6c39ba8a110 2021-07-26T15:55:13.691 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314912.640404_513.1","last_update":"2021-07-26T15:55:12.640404Z"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:55:13.691 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:55:13.692 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:13.693 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:13.693 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:13.734 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:13.735 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:13.932 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314912.640404_513.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:12.640404Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:55:13.933 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:55:14.427 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-62', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:14.428 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-62', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:14.435 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-62 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:14.478 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:14.479 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:14.666 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000002.67.5"},{"key":2,"val":""},{"key":3,"val":"00000000001.71.5"},{"key":4,"val":"00000000001.56.5"},{"key":5,"val":"00000000001.157.5"},{"key":6,"val":""},{"key":7,"val":"00000000001.45.5"},{"key":8,"val":"00000000001.67.5"},{"key":9,"val":"00000000001.51.5"},{"key":10,"val":"00000000002.117.5"}]} 2021-07-26T15:55:14.667 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-62 2021-07-26T15:55:14.667 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:14.668 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:14.668 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:14.725 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:14.726 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:14.941 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.67.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.71.5"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.56.5"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.157.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.45.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.67.5"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.51.5"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.117.5"}}}] 2021-07-26T15:55:14.941 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-62 2021-07-26T15:55:15.391 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-62', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:15.392 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-62', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:15.392 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-62 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:15.431 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:15.432 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:15.661 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":"00000000001.70.5"},{"key":1,"val":"00000000003.69.5"},{"key":2,"val":""},{"key":3,"val":"00000000002.73.5"},{"key":4,"val":"00000000001.56.5"},{"key":5,"val":"00000000003.161.5"},{"key":6,"val":""},{"key":7,"val":"00000000003.49.5"},{"key":8,"val":"00000000002.69.5"},{"key":9,"val":"00000000002.53.5"},{"key":10,"val":"00000000003.119.5"}]} 2021-07-26T15:55:15.662 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-62 2021-07-26T15:55:15.662 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:15.663 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:15.663 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:15.704 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:15.704 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:15.908 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.70.5"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000003.69.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.73.5"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.56.5"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000003.161.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000003.49.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.69.5"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.53.5"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000003.119.5"}}}] 2021-07-26T15:55:15.909 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-62 2021-07-26T15:55:16.135 INFO:tasks.rgw_multisite_tests:test that events are only sent on incremental sync ... ok 2021-07-26T15:55:16.136 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:16.136 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:16.137 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:16.176 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:16.177 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:16.340 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=816a1f73-b2bd-4f0e-a507-b6c39ba8a110 2021-07-26T15:55:16.372 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314916.124986_519.1","last_update":"2021-07-26T15:55:16.124986Z"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:55:16.373 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:55:16.374 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:16.374 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:16.376 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:16.416 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:16.417 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:16.618 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314916.124986_519.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:16.124986Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:55:16.618 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:55:16.619 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:55:16.619 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:16.620 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:16.620 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:16.701 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:16.702 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:16.893 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314916.124986_519.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:16.124986Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:55:16.893 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:55:16.894 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:16.895 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:16.895 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:16.934 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:16.935 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:17.123 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=816a1f73-b2bd-4f0e-a507-b6c39ba8a110 2021-07-26T15:55:17.157 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314916.124986_519.1","last_update":"2021-07-26T15:55:16.124986Z"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:55:17.157 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:55:17.158 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:17.158 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:17.159 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:17.200 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:17.201 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:17.407 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314916.124986_519.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:16.124986Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:55:17.408 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:55:17.454 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:17.455 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:17.455 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:17.491 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:17.491 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:17.667 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=816a1f73-b2bd-4f0e-a507-b6c39ba8a110 2021-07-26T15:55:17.699 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314917.450001_523.1","last_update":"2021-07-26T15:55:17.450001Z"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:55:17.700 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:55:17.700 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:17.701 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:17.702 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:17.740 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:17.740 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:17.932 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314917.450001_523.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:17.450001Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:55:17.933 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:55:17.934 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-63', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:17.934 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-63', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:17.935 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-63 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:17.975 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:17.975 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:18.189 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:55:18.189 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-63 2021-07-26T15:55:18.190 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-63', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:18.190 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-63', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:18.191 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-63 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:18.235 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:18.236 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:18.451 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:55:18.451 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-63 2021-07-26T15:55:18.931 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-63', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:18.932 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-63', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:18.933 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-63 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:18.973 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:18.973 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:19.152 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000002.68.5"},{"key":2,"val":""},{"key":3,"val":"00000000001.46.5"},{"key":4,"val":"00000000001.91.5"},{"key":5,"val":"00000000001.74.5"},{"key":6,"val":""},{"key":7,"val":"00000000001.59.5"},{"key":8,"val":"00000000001.79.5"},{"key":9,"val":"00000000001.59.5"},{"key":10,"val":"00000000002.50.5"}]} 2021-07-26T15:55:19.152 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-63 2021-07-26T15:55:19.153 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-63', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:19.153 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-63', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:19.154 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-63 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:19.198 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:19.199 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:19.406 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.68.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.46.5"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.91.5"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.74.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.59.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.79.5"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.59.5"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.50.5"}}}] 2021-07-26T15:55:19.407 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-63 2021-07-26T15:55:19.557 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-63', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:19.557 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-63', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:19.558 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-63 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:19.598 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:19.598 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:19.801 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000004.72.5"},{"key":2,"val":""},{"key":3,"val":"00000000002.52.5"},{"key":4,"val":"00000000002.93.5"},{"key":5,"val":"00000000002.76.5"},{"key":6,"val":""},{"key":7,"val":"00000000002.61.5"},{"key":8,"val":"00000000002.81.5"},{"key":9,"val":"00000000002.61.5"},{"key":10,"val":"00000000004.56.5"}]} 2021-07-26T15:55:19.801 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-63 2021-07-26T15:55:19.803 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-63', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:19.803 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-63', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:19.804 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-63 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:19.846 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:19.847 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:20.061 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.72.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.52.5"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.93.5"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.76.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.61.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.81.5"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.61.5"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.56.5"}}}] 2021-07-26T15:55:20.061 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-63 2021-07-26T15:55:20.176 INFO:tasks.rgw_multisite_tests:test subscriptions for different events ... ok 2021-07-26T15:55:20.177 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:20.177 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:20.178 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:20.215 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:20.216 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:20.396 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=816a1f73-b2bd-4f0e-a507-b6c39ba8a110 2021-07-26T15:55:20.429 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314920.170374_525.1","last_update":"2021-07-26T15:55:20.170374Z"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:55:20.429 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:55:20.430 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:20.431 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:20.431 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:20.475 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:20.475 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:20.691 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314920.170374_525.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:20.170374Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:55:20.691 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:55:20.692 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:55:20.693 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:20.693 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:20.694 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:20.764 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:20.765 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:20.947 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314920.170374_525.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:20.170374Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:55:20.948 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:55:20.949 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:20.949 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:20.950 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:20.988 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:20.988 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:21.179 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=816a1f73-b2bd-4f0e-a507-b6c39ba8a110 2021-07-26T15:55:21.210 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314920.170374_525.1","last_update":"2021-07-26T15:55:20.170374Z"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:55:21.210 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:55:21.211 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:21.211 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:21.212 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:21.253 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:21.253 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:21.442 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314920.170374_525.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:20.170374Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:55:21.442 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:55:21.478 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:21.479 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:21.479 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:21.514 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:21.514 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:21.695 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=816a1f73-b2bd-4f0e-a507-b6c39ba8a110 2021-07-26T15:55:21.730 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314921.472999_529.1","last_update":"2021-07-26T15:55:21.472999Z"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:55:21.730 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:55:21.731 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:21.732 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:21.732 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:21.775 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:21.775 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:21.959 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314921.472999_529.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:21.472999Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:55:21.960 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:55:26.455 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-64', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:26.456 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-64', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:26.457 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-64 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:26.505 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:26.505 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:26.713 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":"00000000010.77.5"},{"key":1,"val":"00000000010.94.5"},{"key":2,"val":"00000000009.114.5"},{"key":3,"val":"00000000010.64.5"},{"key":4,"val":"00000000007.98.5"},{"key":5,"val":"00000000007.73.5"},{"key":6,"val":"00000000008.82.5"},{"key":7,"val":"00000000010.82.5"},{"key":8,"val":"00000000010.188.5"},{"key":9,"val":"00000000010.84.5"},{"key":10,"val":"00000000009.108.5"}]} 2021-07-26T15:55:26.714 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-64 2021-07-26T15:55:26.715 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-64', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:26.715 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-64', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:26.716 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-64 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:26.760 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:26.760 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:26.990 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000010.77.5"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000010.94.5"}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000009.114.5"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000010.64.5"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000007.98.5"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000007.73.5"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000008.82.5"}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000010.82.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000010.188.5"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000010.84.5"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000009.108.5"}}}] 2021-07-26T15:55:26.990 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-64 2021-07-26T15:55:28.031 INFO:tasks.rgw_multisite_tests:test incremental fetching of events from a subscription ... ok 2021-07-26T15:55:28.032 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:28.033 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:28.034 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:28.071 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:28.072 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:28.238 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=816a1f73-b2bd-4f0e-a507-b6c39ba8a110 2021-07-26T15:55:28.271 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314928.025801_531.1","last_update":"2021-07-26T15:55:28.025801Z"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:55:28.271 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:55:28.272 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:28.272 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:28.273 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:28.314 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:28.314 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:28.543 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314928.025801_531.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:28.025801Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:55:28.543 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:55:28.548 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:55:28.548 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:28.549 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:28.549 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:28.587 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:28.588 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:28.782 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314928.025801_531.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:28.025801Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:55:28.783 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:55:28.783 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:28.784 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:28.784 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:28.823 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:28.823 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:29.011 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=816a1f73-b2bd-4f0e-a507-b6c39ba8a110 2021-07-26T15:55:29.044 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314928.025801_531.1","last_update":"2021-07-26T15:55:28.025801Z"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:55:29.045 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:55:29.045 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:29.046 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:29.046 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:29.085 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:29.086 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:29.299 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314928.025801_531.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:28.025801Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:55:29.299 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:55:29.337 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:29.338 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:29.339 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:29.378 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:29.379 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:29.564 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=816a1f73-b2bd-4f0e-a507-b6c39ba8a110 2021-07-26T15:55:29.599 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314929.332108_535.1","last_update":"2021-07-26T15:55:29.332108Z"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:55:29.600 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:55:29.600 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:29.601 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:29.601 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:29.642 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:29.643 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:29.828 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314929.332108_535.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:29.332108Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:55:29.829 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:55:30.287 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-65', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:30.288 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-65', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:30.288 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-65 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:30.326 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:30.326 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:30.517 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000002.66.5"},{"key":2,"val":""},{"key":3,"val":"00000000001.58.5"},{"key":4,"val":"00000000001.100.5"},{"key":5,"val":"00000000001.115.5"},{"key":6,"val":""},{"key":7,"val":"00000000001.117.5"},{"key":8,"val":"00000000001.57.5"},{"key":9,"val":"00000000001.87.5"},{"key":10,"val":"00000000002.52.5"}]} 2021-07-26T15:55:30.517 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-65 2021-07-26T15:55:30.518 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:30.518 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:30.519 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:30.564 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:30.565 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:30.784 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.66.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.58.5"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.100.5"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.115.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.117.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.57.5"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.87.5"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.52.5"}}}] 2021-07-26T15:55:30.784 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-65 2021-07-26T15:55:30.971 INFO:tasks.rgw_multisite_tests:test acking of some events in a subscription ... ok 2021-07-26T15:55:30.972 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:30.972 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:30.973 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:31.012 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:31.013 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:31.189 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=816a1f73-b2bd-4f0e-a507-b6c39ba8a110 2021-07-26T15:55:31.224 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314930.964419_539.1","last_update":"2021-07-26T15:55:30.964419Z"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:55:31.224 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:55:31.225 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:31.225 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:31.226 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:31.265 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:31.265 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:31.482 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314930.964419_539.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:30.964419Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:55:31.483 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:55:31.486 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:55:31.487 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:31.489 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:31.490 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:31.531 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:31.531 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:31.747 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314930.964419_539.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:30.964419Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:55:31.748 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:55:31.749 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:31.749 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:31.750 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:31.789 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:31.789 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:31.980 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=816a1f73-b2bd-4f0e-a507-b6c39ba8a110 2021-07-26T15:55:32.009 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314930.964419_539.1","last_update":"2021-07-26T15:55:30.964419Z"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:55:32.010 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:55:32.010 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:32.011 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:32.011 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:32.050 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:32.051 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:32.261 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314930.964419_539.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:30.964419Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:55:32.261 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:55:32.297 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:32.298 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:32.299 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:32.333 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:32.334 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:32.496 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=816a1f73-b2bd-4f0e-a507-b6c39ba8a110 2021-07-26T15:55:32.522 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314932.293442_543.1","last_update":"2021-07-26T15:55:32.293442Z"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:55:32.522 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:55:32.523 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:32.524 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:32.524 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:32.565 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:32.566 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:32.786 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314932.293442_543.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:32.293442Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:55:32.787 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:55:33.091 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-66', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:33.092 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'mnwbfc-66', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:33.092 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket mnwbfc-66 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:33.130 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:33.131 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:33.182 INFO:tasks.rgw.c2.client.0.smithi197.stdout:*** Caught signal (Segmentation fault) ** 2021-07-26T15:55:33.182 INFO:tasks.rgw.c2.client.0.smithi197.stdout: in thread 7fa8987f0700 thread_name:rados_async 2021-07-26T15:55:33.184 INFO:tasks.rgw.c2.client.0.smithi197.stdout: ceph version 15.2.13-213-g0f589fd5 (0f589fd5a12a7ee844fceabe951140b18faf866b) octopus (stable) 2021-07-26T15:55:33.185 INFO:tasks.rgw.c2.client.0.smithi197.stdout: 1: (()+0x46210) [0x7fa8d5f4a210] 2021-07-26T15:55:33.185 INFO:tasks.rgw.c2.client.0.smithi197.stdout: 2: (rgw::putobj::ETagVerifier_MPU::process(ceph::buffer::v15_2_0::list&&, unsigned long)+0x44) [0x7fa8d6bb3114] 2021-07-26T15:55:33.185 INFO:tasks.rgw.c2.client.0.smithi197.stdout: 3: (RGWRados::fetch_remote_obj(RGWObjectCtx&, rgw_user const&, req_info*, rgw_zone_id const&, rgw_obj const&, rgw_obj const&, RGWBucketInfo const&, RGWBucketInfo const*, std::optional, std::chrono::time_point > >*, std::chrono::time_point > >*, std::chrono::time_point > > const*, std::chrono::time_point > > const*, bool, char const*, char const*, RGWRados::AttrsMod, bool, std::map, std::allocator >, ceph::buffer::v15_2_0::list, std::less, std::allocator > >, std::allocator, std::allocator > const, ceph::buffer::v15_2_0::list> > >&, RGWObjCategory, std::optional, std::chrono::time_point > >, std::__cxx11::basic_string, std::allocator >*, std::__cxx11::basic_string, std::allocator >*, void (*)(long, void*), void*, DoutPrefixProvider const*, RGWFetchObjFilter*, rgw_zone_set*, std::optional*)+0xf87) [0x7fa8d69ea347] 2021-07-26T15:55:33.185 INFO:tasks.rgw.c2.client.0.smithi197.stdout: 4: (RGWAsyncFetchRemoteObj::_send_request()+0x4d6) [0x7fa8d69181e6] 2021-07-26T15:55:33.186 INFO:tasks.rgw.c2.client.0.smithi197.stdout: 5: (RGWAsyncRadosProcessor::handle_request(RGWAsyncRadosRequest*)+0x25) [0x7fa8d69123c5] 2021-07-26T15:55:33.186 INFO:tasks.rgw.c2.client.0.smithi197.stdout: 6: (RGWAsyncRadosProcessor::RGWWQ::_process(RGWAsyncRadosRequest*, ThreadPool::TPHandle&)+0x11) [0x7fa8d691a6c1] 2021-07-26T15:55:33.186 INFO:tasks.rgw.c2.client.0.smithi197.stdout: 7: (ThreadPool::worker(ThreadPool::WorkThread*)+0x5bb) [0x7fa8cd25cc8b] 2021-07-26T15:55:33.186 INFO:tasks.rgw.c2.client.0.smithi197.stdout: 8: (ThreadPool::WorkThread::entry()+0x15) [0x7fa8cd25dd55] 2021-07-26T15:55:33.187 INFO:tasks.rgw.c2.client.0.smithi197.stdout: 9: (()+0x9609) [0x7fa8ccdb9609] 2021-07-26T15:55:33.187 INFO:tasks.rgw.c2.client.0.smithi197.stdout: 10: (clone()+0x43) [0x7fa8d6026293] 2021-07-26T15:55:33.187 INFO:tasks.rgw.c2.client.0.smithi197.stdout:2021-07-26T15:55:33.179+0000 7fa8987f0700 -1 *** Caught signal (Segmentation fault) ** 2021-07-26T15:55:33.188 INFO:tasks.rgw.c2.client.0.smithi197.stdout: in thread 7fa8987f0700 thread_name:rados_async 2021-07-26T15:55:33.188 INFO:tasks.rgw.c2.client.0.smithi197.stdout: 2021-07-26T15:55:33.188 INFO:tasks.rgw.c2.client.0.smithi197.stdout: ceph version 15.2.13-213-g0f589fd5 (0f589fd5a12a7ee844fceabe951140b18faf866b) octopus (stable) 2021-07-26T15:55:33.188 INFO:tasks.rgw.c2.client.0.smithi197.stdout: 1: (()+0x46210) [0x7fa8d5f4a210] 2021-07-26T15:55:33.189 INFO:tasks.rgw.c2.client.0.smithi197.stdout: 2: (rgw::putobj::ETagVerifier_MPU::process(ceph::buffer::v15_2_0::list&&, unsigned long)+0x44) [0x7fa8d6bb3114] 2021-07-26T15:55:33.189 INFO:tasks.rgw.c2.client.0.smithi197.stdout: 3: (RGWRados::fetch_remote_obj(RGWObjectCtx&, rgw_user const&, req_info*, rgw_zone_id const&, rgw_obj const&, rgw_obj const&, RGWBucketInfo const&, RGWBucketInfo const*, std::optional, std::chrono::time_point > >*, std::chrono::time_point > >*, std::chrono::time_point > > const*, std::chrono::time_point > > const*, bool, char const*, char const*, RGWRados::AttrsMod, bool, std::map, std::allocator >, ceph::buffer::v15_2_0::list, std::less, std::allocator > >, std::allocator, std::allocator > const, ceph::buffer::v15_2_0::list> > >&, RGWObjCategory, std::optional, std::chrono::time_point > >, std::__cxx11::basic_string, std::allocator >*, std::__cxx11::basic_string, std::allocator >*, void (*)(long, void*), void*, DoutPrefixProvider const*, RGWFetchObjFilter*, rgw_zone_set*, std::optional*)+0xf87) [0x7fa8d69ea347] 2021-07-26T15:55:33.189 INFO:tasks.rgw.c2.client.0.smithi197.stdout: 4: (RGWAsyncFetchRemoteObj::_send_request()+0x4d6) [0x7fa8d69181e6] 2021-07-26T15:55:33.189 INFO:tasks.rgw.c2.client.0.smithi197.stdout: 5: (RGWAsyncRadosProcessor::handle_request(RGWAsyncRadosRequest*)+0x25) [0x7fa8d69123c5] 2021-07-26T15:55:33.190 INFO:tasks.rgw.c2.client.0.smithi197.stdout: 6: (RGWAsyncRadosProcessor::RGWWQ::_process(RGWAsyncRadosRequest*, ThreadPool::TPHandle&)+0x11) [0x7fa8d691a6c1] 2021-07-26T15:55:33.190 INFO:tasks.rgw.c2.client.0.smithi197.stdout: 7: (ThreadPool::worker(ThreadPool::WorkThread*)+0x5bb) [0x7fa8cd25cc8b] 2021-07-26T15:55:33.190 INFO:tasks.rgw.c2.client.0.smithi197.stdout: 8: (ThreadPool::WorkThread::entry()+0x15) [0x7fa8cd25dd55] 2021-07-26T15:55:33.190 INFO:tasks.rgw.c2.client.0.smithi197.stdout: 9: (()+0x9609) [0x7fa8ccdb9609] 2021-07-26T15:55:33.191 INFO:tasks.rgw.c2.client.0.smithi197.stdout: 10: (clone()+0x43) [0x7fa8d6026293] 2021-07-26T15:55:33.191 INFO:tasks.rgw.c2.client.0.smithi197.stdout: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2021-07-26T15:55:33.191 INFO:tasks.rgw.c2.client.0.smithi197.stdout: 2021-07-26T15:55:33.202 INFO:tasks.rgw.c2.client.0.smithi197.stdout: 0> 2021-07-26T15:55:33.179+0000 7fa8987f0700 -1 *** Caught signal (Segmentation fault) ** 2021-07-26T15:55:33.202 INFO:tasks.rgw.c2.client.0.smithi197.stdout: in thread 7fa8987f0700 thread_name:rados_async 2021-07-26T15:55:33.203 INFO:tasks.rgw.c2.client.0.smithi197.stdout: 2021-07-26T15:55:33.203 INFO:tasks.rgw.c2.client.0.smithi197.stdout: ceph version 15.2.13-213-g0f589fd5 (0f589fd5a12a7ee844fceabe951140b18faf866b) octopus (stable) 2021-07-26T15:55:33.203 INFO:tasks.rgw.c2.client.0.smithi197.stdout: 1: (()+0x46210) [0x7fa8d5f4a210] 2021-07-26T15:55:33.203 INFO:tasks.rgw.c2.client.0.smithi197.stdout: 2: (rgw::putobj::ETagVerifier_MPU::process(ceph::buffer::v15_2_0::list&&, unsigned long)+0x44) [0x7fa8d6bb3114] 2021-07-26T15:55:33.204 INFO:tasks.rgw.c2.client.0.smithi197.stdout: 3: (RGWRados::fetch_remote_obj(RGWObjectCtx&, rgw_user const&, req_info*, rgw_zone_id const&, rgw_obj const&, rgw_obj const&, RGWBucketInfo const&, RGWBucketInfo const*, std::optional, std::chrono::time_point > >*, std::chrono::time_point > >*, std::chrono::time_point > > const*, std::chrono::time_point > > const*, bool, char const*, char const*, RGWRados::AttrsMod, bool, std::map, std::allocator >, ceph::buffer::v15_2_0::list, std::less, std::allocator > >, std::allocator, std::allocator > const, ceph::buffer::v15_2_0::list> > >&, RGWObjCategory, std::optional, std::chrono::time_point > >, std::__cxx11::basic_string, std::allocator >*, std::__cxx11::basic_string, std::allocator >*, void (*)(long, void*), void*, DoutPrefixProvider const*, RGWFetchObjFilter*, rgw_zone_set*, std::optional*)+0xf87) [0x7fa8d69ea347] 2021-07-26T15:55:33.204 INFO:tasks.rgw.c2.client.0.smithi197.stdout: 4: (RGWAsyncFetchRemoteObj::_send_request()+0x4d6) [0x7fa8d69181e6] 2021-07-26T15:55:33.204 INFO:tasks.rgw.c2.client.0.smithi197.stdout: 5: (RGWAsyncRadosProcessor::handle_request(RGWAsyncRadosRequest*)+0x25) [0x7fa8d69123c5] 2021-07-26T15:55:33.204 INFO:tasks.rgw.c2.client.0.smithi197.stdout: 6: (RGWAsyncRadosProcessor::RGWWQ::_process(RGWAsyncRadosRequest*, ThreadPool::TPHandle&)+0x11) [0x7fa8d691a6c1] 2021-07-26T15:55:33.205 INFO:tasks.rgw.c2.client.0.smithi197.stdout: 7: (ThreadPool::worker(ThreadPool::WorkThread*)+0x5bb) [0x7fa8cd25cc8b] 2021-07-26T15:55:33.205 INFO:tasks.rgw.c2.client.0.smithi197.stdout: 8: (ThreadPool::WorkThread::entry()+0x15) [0x7fa8cd25dd55] 2021-07-26T15:55:33.205 INFO:tasks.rgw.c2.client.0.smithi197.stdout: 9: (()+0x9609) [0x7fa8ccdb9609] 2021-07-26T15:55:33.205 INFO:tasks.rgw.c2.client.0.smithi197.stdout: 10: (clone()+0x43) [0x7fa8d6026293] 2021-07-26T15:55:33.206 INFO:tasks.rgw.c2.client.0.smithi197.stdout: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2021-07-26T15:55:33.206 INFO:tasks.rgw.c2.client.0.smithi197.stdout: 2021-07-26T15:55:33.216 INFO:tasks.rgw.c2.client.0.smithi197.stdout: -66> 2021-07-26T15:55:33.179+0000 7fa8987f0700 -1 *** Caught signal (Segmentation fault) ** 2021-07-26T15:55:33.217 INFO:tasks.rgw.c2.client.0.smithi197.stdout: in thread 7fa8987f0700 thread_name:rados_async 2021-07-26T15:55:33.217 INFO:tasks.rgw.c2.client.0.smithi197.stdout: 2021-07-26T15:55:33.217 INFO:tasks.rgw.c2.client.0.smithi197.stdout: ceph version 15.2.13-213-g0f589fd5 (0f589fd5a12a7ee844fceabe951140b18faf866b) octopus (stable) 2021-07-26T15:55:33.217 INFO:tasks.rgw.c2.client.0.smithi197.stdout: 1: (()+0x46210) [0x7fa8d5f4a210] 2021-07-26T15:55:33.217 INFO:tasks.rgw.c2.client.0.smithi197.stdout: 2: (rgw::putobj::ETagVerifier_MPU::process(ceph::buffer::v15_2_0::list&&, unsigned long)+0x44) [0x7fa8d6bb3114] 2021-07-26T15:55:33.218 INFO:tasks.rgw.c2.client.0.smithi197.stdout: 3: (RGWRados::fetch_remote_obj(RGWObjectCtx&, rgw_user const&, req_info*, rgw_zone_id const&, rgw_obj const&, rgw_obj const&, RGWBucketInfo const&, RGWBucketInfo const*, std::optional, std::chrono::time_point > >*, std::chrono::time_point > >*, std::chrono::time_point > > const*, std::chrono::time_point > > const*, bool, char const*, char const*, RGWRados::AttrsMod, bool, std::map, std::allocator >, ceph::buffer::v15_2_0::list, std::less, std::allocator > >, std::allocator, std::allocator > const, ceph::buffer::v15_2_0::list> > >&, RGWObjCategory, std::optional, std::chrono::time_point > >, std::__cxx11::basic_string, std::allocator >*, std::__cxx11::basic_string, std::allocator >*, void (*)(long, void*), void*, DoutPrefixProvider const*, RGWFetchObjFilter*, rgw_zone_set*, std::optional*)+0xf87) [0x7fa8d69ea347] 2021-07-26T15:55:33.218 INFO:tasks.rgw.c2.client.0.smithi197.stdout: 4: (RGWAsyncFetchRemoteObj::_send_request()+0x4d6) [0x7fa8d69181e6] 2021-07-26T15:55:33.218 INFO:tasks.rgw.c2.client.0.smithi197.stdout: 5: (RGWAsyncRadosProcessor::handle_request(RGWAsyncRadosRequest*)+0x25) [0x7fa8d69123c5] 2021-07-26T15:55:33.218 INFO:tasks.rgw.c2.client.0.smithi197.stdout: 6: (RGWAsyncRadosProcessor::RGWWQ::_process(RGWAsyncRadosRequest*, ThreadPool::TPHandle&)+0x11) [0x7fa8d691a6c1] 2021-07-26T15:55:33.219 INFO:tasks.rgw.c2.client.0.smithi197.stdout: 7: (ThreadPool::worker(ThreadPool::WorkThread*)+0x5bb) [0x7fa8cd25cc8b] 2021-07-26T15:55:33.219 INFO:tasks.rgw.c2.client.0.smithi197.stdout: 8: (ThreadPool::WorkThread::entry()+0x15) [0x7fa8cd25dd55] 2021-07-26T15:55:33.219 INFO:tasks.rgw.c2.client.0.smithi197.stdout: 9: (()+0x9609) [0x7fa8ccdb9609] 2021-07-26T15:55:33.219 INFO:tasks.rgw.c2.client.0.smithi197.stdout: 10: (clone()+0x43) [0x7fa8d6026293] 2021-07-26T15:55:33.220 INFO:tasks.rgw.c2.client.0.smithi197.stdout: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2021-07-26T15:55:33.220 INFO:tasks.rgw.c2.client.0.smithi197.stdout: 2021-07-26T15:55:33.306 INFO:tasks.rgw.c2.client.0.smithi197.stderr:daemon-helper: command crashed with signal 11 2021-07-26T15:55:33.339 INFO:teuthology.orchestra.run.smithi183.stdout:{"markers":[{"key":0,"val":"00000000001.92.5"},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":"00000000001.76.5"},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":"00000000005.86.5"},{"key":10,"val":""}]} 2021-07-26T15:55:33.340 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-66 2021-07-26T15:55:33.341 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-66', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:33.341 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'mnwbfc-66', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:33.342 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket mnwbfc-66 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:33.385 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:33.386 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:33.606 INFO:teuthology.orchestra.run.smithi197.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.92.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.76.5"}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000005.86.5"}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:55:33.609 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=mnwbfc-66 2021-07-26T15:55:33.700 INFO:tasks.rgw_multisite_tests:test object creation notifications in using put/copy/post ... ok 2021-07-26T15:55:33.701 INFO:tasks.rgw_multisite_tests:test object creation s3 notifications in using put/copy/post on master ... ok 2021-07-26T15:55:33.702 INFO:tasks.rgw_multisite_tests:test multipart object upload on master ... ok 2021-07-26T15:55:33.703 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:33.703 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:33.704 DEBUG:teuthology.orchestra.run.smithi183:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:33.743 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:33.743 INFO:teuthology.orchestra.run.smithi183.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:33.934 INFO:teuthology.orchestra.run.smithi183.stderr:No --period given, using current period=816a1f73-b2bd-4f0e-a507-b6c39ba8a110 2021-07-26T15:55:33.967 INFO:teuthology.orchestra.run.smithi183.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1627314933.693943_551.1","last_update":"2021-07-26T15:55:33.693943Z"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:55:33.967 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:55:33.968 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:33.969 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:33.969 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:34.008 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:34.008 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:34.221 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314932.293442_543.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:32.293442Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:55:34.222 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314933.693943_551.1 target=1_1627314932.293442_543.1 2021-07-26T15:55:36.630 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~0s 2021-07-26T15:55:39.223 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:39.225 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:39.226 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:39.266 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:39.267 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:39.478 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314932.293442_543.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:32.293442Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:55:39.479 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314933.693943_551.1 target=1_1627314932.293442_543.1 2021-07-26T15:55:42.240 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~6s 2021-07-26T15:55:44.480 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:44.481 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:44.481 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:44.522 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:44.522 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:44.737 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314932.293442_543.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:32.293442Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:55:44.738 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314933.693943_551.1 target=1_1627314932.293442_543.1 2021-07-26T15:55:47.845 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~11s 2021-07-26T15:55:49.740 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:49.741 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:49.741 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:49.781 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:49.782 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:49.979 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314932.293442_543.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:32.293442Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:55:49.980 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314933.693943_551.1 target=1_1627314932.293442_543.1 2021-07-26T15:55:53.452 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~17s 2021-07-26T15:55:54.981 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:54.982 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:54.983 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:55.024 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:55.025 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:55.243 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314932.293442_543.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:32.293442Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:55:55.244 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314933.693943_551.1 target=1_1627314932.293442_543.1 2021-07-26T15:55:59.059 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~22s 2021-07-26T15:56:00.246 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:56:00.247 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:56:00.247 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:56:00.288 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:56:00.288 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:56:00.520 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314932.293442_543.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:32.293442Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:56:00.522 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314933.693943_551.1 target=1_1627314932.293442_543.1 2021-07-26T15:56:04.668 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~28s 2021-07-26T15:56:05.523 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:56:05.524 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:56:05.524 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:56:05.567 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:56:05.568 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:56:05.803 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314932.293442_543.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:32.293442Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:56:05.804 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314933.693943_551.1 target=1_1627314932.293442_543.1 2021-07-26T15:56:10.291 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~34s 2021-07-26T15:56:10.807 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:56:10.808 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:56:10.808 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:56:10.862 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:56:10.863 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:56:11.070 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314932.293442_543.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:32.293442Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:56:11.071 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314933.693943_551.1 target=1_1627314932.293442_543.1 2021-07-26T15:56:15.898 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~39s 2021-07-26T15:56:16.072 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:56:16.073 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:56:16.074 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:56:16.124 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:56:16.127 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:56:16.346 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314932.293442_543.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:32.293442Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:56:16.347 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314933.693943_551.1 target=1_1627314932.293442_543.1 2021-07-26T15:56:21.348 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:56:21.349 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:56:21.350 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:56:21.407 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:56:21.408 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:56:21.507 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~45s 2021-07-26T15:56:21.619 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314932.293442_543.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:32.293442Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:56:21.620 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314933.693943_551.1 target=1_1627314932.293442_543.1 2021-07-26T15:56:26.628 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:56:26.629 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:56:26.630 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:56:26.670 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:56:26.671 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:56:26.884 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314932.293442_543.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:32.293442Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:56:26.885 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314933.693943_551.1 target=1_1627314932.293442_543.1 2021-07-26T15:56:27.118 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~50s 2021-07-26T15:56:31.886 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:56:31.887 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:56:31.887 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:56:31.924 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:56:31.925 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:56:32.138 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314932.293442_543.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:32.293442Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:56:32.139 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314933.693943_551.1 target=1_1627314932.293442_543.1 2021-07-26T15:56:32.729 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~56s 2021-07-26T15:56:37.141 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:56:37.142 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:56:37.143 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:56:37.184 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:56:37.185 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:56:37.407 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314932.293442_543.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:32.293442Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:56:37.407 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314933.693943_551.1 target=1_1627314932.293442_543.1 2021-07-26T15:56:38.335 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~62s 2021-07-26T15:56:42.409 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:56:42.410 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:56:42.411 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:56:42.461 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:56:42.462 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:56:42.681 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314932.293442_543.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:32.293442Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:56:42.681 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314933.693943_551.1 target=1_1627314932.293442_543.1 2021-07-26T15:56:43.943 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~67s 2021-07-26T15:56:47.682 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:56:47.683 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:56:47.684 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:56:47.724 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:56:47.725 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:56:47.943 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314932.293442_543.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:32.293442Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:56:47.943 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314933.693943_551.1 target=1_1627314932.293442_543.1 2021-07-26T15:56:49.550 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~73s 2021-07-26T15:56:52.945 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:56:52.946 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:56:52.946 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:56:52.985 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:56:52.986 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:56:53.216 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314932.293442_543.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:32.293442Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:56:53.217 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314933.693943_551.1 target=1_1627314932.293442_543.1 2021-07-26T15:56:55.157 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~79s 2021-07-26T15:56:58.218 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:56:58.219 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:56:58.220 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:56:58.262 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:56:58.262 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:56:58.477 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314932.293442_543.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:32.293442Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:56:58.477 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314933.693943_551.1 target=1_1627314932.293442_543.1 2021-07-26T15:57:00.765 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~84s 2021-07-26T15:57:03.479 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:57:03.480 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:57:03.481 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:57:03.521 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:57:03.521 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:57:03.746 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314932.293442_543.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:32.293442Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:57:03.747 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314933.693943_551.1 target=1_1627314932.293442_543.1 2021-07-26T15:57:06.371 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~90s 2021-07-26T15:57:08.748 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:57:08.749 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:57:08.749 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:57:08.791 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:57:08.791 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:57:08.997 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314932.293442_543.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:32.293442Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:57:08.998 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314933.693943_551.1 target=1_1627314932.293442_543.1 2021-07-26T15:57:11.976 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~95s 2021-07-26T15:57:14.000 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:57:14.001 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:57:14.002 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:57:14.042 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:57:14.043 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:57:14.253 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314932.293442_543.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:32.293442Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:57:14.254 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314933.693943_551.1 target=1_1627314932.293442_543.1 2021-07-26T15:57:17.581 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~101s 2021-07-26T15:57:19.257 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:57:19.258 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:57:19.258 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:57:19.299 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:57:19.300 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:57:19.504 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314932.293442_543.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:32.293442Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:57:19.505 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314933.693943_551.1 target=1_1627314932.293442_543.1 2021-07-26T15:57:23.187 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~107s 2021-07-26T15:57:24.506 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:57:24.507 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:57:24.508 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:57:24.551 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:57:24.551 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:57:24.761 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314932.293442_543.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:32.293442Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:57:24.762 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314933.693943_551.1 target=1_1627314932.293442_543.1 2021-07-26T15:57:28.793 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~112s 2021-07-26T15:57:29.763 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:57:29.765 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:57:29.766 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:57:29.802 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:57:29.802 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:57:30.004 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314932.293442_543.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:32.293442Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:57:30.004 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314933.693943_551.1 target=1_1627314932.293442_543.1 2021-07-26T15:57:34.401 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~118s 2021-07-26T15:57:35.010 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:57:35.011 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:57:35.012 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:57:35.055 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:57:35.055 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:57:35.262 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314932.293442_543.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:32.293442Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:57:35.262 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314933.693943_551.1 target=1_1627314932.293442_543.1 2021-07-26T15:57:40.008 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~123s 2021-07-26T15:57:40.263 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:57:40.264 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:57:40.265 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:57:40.306 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:57:40.307 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:57:40.524 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314932.293442_543.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:32.293442Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:57:40.526 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314933.693943_551.1 target=1_1627314932.293442_543.1 2021-07-26T15:57:45.528 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:57:45.529 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:57:45.531 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:57:45.571 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:57:45.571 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:57:45.615 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~129s 2021-07-26T15:57:45.782 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314932.293442_543.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:32.293442Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:57:45.782 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314933.693943_551.1 target=1_1627314932.293442_543.1 2021-07-26T15:57:50.784 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:57:50.784 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:57:50.785 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:57:50.829 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:57:50.829 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:57:51.032 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314932.293442_543.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:32.293442Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:57:51.177 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314933.693943_551.1 target=1_1627314932.293442_543.1 2021-07-26T15:57:51.278 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~135s 2021-07-26T15:57:56.179 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:57:56.180 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:57:56.180 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:57:56.224 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:57:56.224 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:57:56.435 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314932.293442_543.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:32.293442Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:57:56.436 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314933.693943_551.1 target=1_1627314932.293442_543.1 2021-07-26T15:57:56.884 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~140s 2021-07-26T15:58:01.437 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:01.437 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:01.438 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:58:01.477 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:58:01.478 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:58:01.695 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314932.293442_543.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:32.293442Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:58:01.696 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314933.693943_551.1 target=1_1627314932.293442_543.1 2021-07-26T15:58:02.491 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~146s 2021-07-26T15:58:06.698 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:06.699 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:06.699 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:58:06.738 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:58:06.739 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:58:06.939 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314932.293442_543.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:32.293442Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:58:06.940 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314933.693943_551.1 target=1_1627314932.293442_543.1 2021-07-26T15:58:08.101 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~151s 2021-07-26T15:58:11.941 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:11.942 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:11.942 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:58:11.980 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:58:11.981 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:58:12.188 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314932.293442_543.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:32.293442Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:58:12.189 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314933.693943_551.1 target=1_1627314932.293442_543.1 2021-07-26T15:58:13.707 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~157s 2021-07-26T15:58:17.191 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:17.192 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:17.192 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:58:17.234 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:58:17.235 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:58:17.461 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314932.293442_543.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:32.293442Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:58:17.462 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314933.693943_551.1 target=1_1627314932.293442_543.1 2021-07-26T15:58:19.312 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~163s 2021-07-26T15:58:22.463 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:22.464 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:22.465 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:58:22.505 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:58:22.505 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:58:22.727 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314932.293442_543.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:32.293442Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:58:22.728 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314933.693943_551.1 target=1_1627314932.293442_543.1 2021-07-26T15:58:24.919 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~168s 2021-07-26T15:58:27.729 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:27.730 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:27.731 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:58:27.769 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:58:27.770 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:58:27.977 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314932.293442_543.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:32.293442Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:58:27.978 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314933.693943_551.1 target=1_1627314932.293442_543.1 2021-07-26T15:58:30.526 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~174s 2021-07-26T15:58:32.979 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:32.980 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:32.981 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:58:33.021 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:58:33.021 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:58:33.240 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314932.293442_543.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:32.293442Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:58:33.241 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314933.693943_551.1 target=1_1627314932.293442_543.1 2021-07-26T15:58:36.132 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~180s 2021-07-26T15:58:38.242 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:38.243 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:38.244 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:58:38.284 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:58:38.285 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:58:38.508 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314932.293442_543.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:32.293442Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:58:38.509 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314933.693943_551.1 target=1_1627314932.293442_543.1 2021-07-26T15:58:41.737 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~185s 2021-07-26T15:58:43.510 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:43.511 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:43.511 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:58:43.553 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:58:43.554 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:58:43.767 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314932.293442_543.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:32.293442Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:58:43.768 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314933.693943_551.1 target=1_1627314932.293442_543.1 2021-07-26T15:58:47.344 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~191s 2021-07-26T15:58:48.769 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:48.770 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:48.770 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:58:48.811 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:58:48.811 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:58:49.008 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314932.293442_543.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:32.293442Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:58:49.008 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314933.693943_551.1 target=1_1627314932.293442_543.1 2021-07-26T15:58:52.951 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~196s 2021-07-26T15:58:54.009 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:54.010 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:54.011 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:58:54.049 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:58:54.050 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:58:54.254 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314932.293442_543.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:32.293442Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:58:54.255 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314933.693943_551.1 target=1_1627314932.293442_543.1 2021-07-26T15:58:58.556 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~202s 2021-07-26T15:58:59.256 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:59.257 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:59.258 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:58:59.297 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:58:59.297 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:58:59.499 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314932.293442_543.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:32.293442Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:58:59.499 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314933.693943_551.1 target=1_1627314932.293442_543.1 2021-07-26T15:59:04.162 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~208s 2021-07-26T15:59:04.501 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:04.502 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:04.503 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:59:04.542 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:59:04.542 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:59:04.759 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314932.293442_543.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:32.293442Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:59:04.760 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314933.693943_551.1 target=1_1627314932.293442_543.1 2021-07-26T15:59:09.762 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:09.762 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:09.763 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:59:09.766 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~213s 2021-07-26T15:59:09.805 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:59:09.807 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:59:10.000 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314932.293442_543.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:32.293442Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:59:10.000 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314933.693943_551.1 target=1_1627314932.293442_543.1 2021-07-26T15:59:15.002 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:15.002 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:15.003 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:59:15.044 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:59:15.044 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:59:15.262 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314932.293442_543.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:32.293442Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:59:15.263 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314933.693943_551.1 target=1_1627314932.293442_543.1 2021-07-26T15:59:15.372 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~219s 2021-07-26T15:59:20.264 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:20.265 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:20.265 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:59:20.305 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:59:20.305 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:59:20.523 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314932.293442_543.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:32.293442Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:59:20.524 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314933.693943_551.1 target=1_1627314932.293442_543.1 2021-07-26T15:59:20.977 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~224s 2021-07-26T15:59:25.525 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:25.526 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:25.527 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:59:25.566 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:59:25.566 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:59:25.778 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314932.293442_543.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:32.293442Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:59:25.778 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314933.693943_551.1 target=1_1627314932.293442_543.1 2021-07-26T15:59:26.583 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~230s 2021-07-26T15:59:30.779 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:30.780 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:30.781 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:59:30.818 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:59:30.819 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:59:31.022 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314932.293442_543.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:32.293442Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:59:31.023 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314933.693943_551.1 target=1_1627314932.293442_543.1 2021-07-26T15:59:32.189 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~236s 2021-07-26T15:59:36.025 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:36.025 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:36.026 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:59:36.067 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:59:36.067 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:59:36.274 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314932.293442_543.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:32.293442Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:59:36.275 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314933.693943_551.1 target=1_1627314932.293442_543.1 2021-07-26T15:59:37.796 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~241s 2021-07-26T15:59:41.276 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:41.277 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:41.278 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:59:41.318 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:59:41.319 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:59:41.525 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314932.293442_543.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:32.293442Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:59:41.526 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314933.693943_551.1 target=1_1627314932.293442_543.1 2021-07-26T15:59:43.402 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~247s 2021-07-26T15:59:46.528 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:46.528 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:46.529 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:59:46.569 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:59:46.569 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:59:46.778 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314932.293442_543.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:32.293442Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:59:46.779 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314933.693943_551.1 target=1_1627314932.293442_543.1 2021-07-26T15:59:49.007 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~252s 2021-07-26T15:59:51.781 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:51.782 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:51.783 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:59:51.823 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:59:51.824 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:59:52.024 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314932.293442_543.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:32.293442Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:59:52.025 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314933.693943_551.1 target=1_1627314932.293442_543.1 2021-07-26T15:59:54.613 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~258s 2021-07-26T15:59:57.026 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:57.027 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:57.028 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:59:57.068 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:59:57.068 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:59:57.271 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314932.293442_543.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:32.293442Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:59:57.272 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314933.693943_551.1 target=1_1627314932.293442_543.1 2021-07-26T16:00:00.219 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~264s 2021-07-26T16:00:02.273 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:02.274 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:02.275 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:00:02.314 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:00:02.314 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:00:02.518 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314932.293442_543.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:32.293442Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:00:02.519 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314933.693943_551.1 target=1_1627314932.293442_543.1 2021-07-26T16:00:05.827 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~269s 2021-07-26T16:00:07.521 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:07.522 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:07.522 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:00:07.562 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:00:07.562 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:00:07.767 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314932.293442_543.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:32.293442Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:00:07.768 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314933.693943_551.1 target=1_1627314932.293442_543.1 2021-07-26T16:00:11.433 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~275s 2021-07-26T16:00:12.769 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:12.770 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:12.770 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:00:12.809 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:00:12.810 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:00:13.011 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314932.293442_543.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:32.293442Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:00:13.012 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314933.693943_551.1 target=1_1627314932.293442_543.1 2021-07-26T16:00:17.039 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~280s 2021-07-26T16:00:18.013 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:18.014 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:18.015 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:00:18.054 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:00:18.054 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:00:18.261 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314932.293442_543.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:32.293442Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:00:18.262 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314933.693943_551.1 target=1_1627314932.293442_543.1 2021-07-26T16:00:22.645 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~286s 2021-07-26T16:00:23.263 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:23.265 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:23.265 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:00:23.306 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:00:23.306 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:00:23.524 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314932.293442_543.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:32.293442Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:00:23.524 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314933.693943_551.1 target=1_1627314932.293442_543.1 2021-07-26T16:00:28.251 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~292s 2021-07-26T16:00:28.525 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:28.526 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:28.527 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:00:28.565 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:00:28.566 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:00:28.777 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314932.293442_543.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:32.293442Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:00:28.778 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314933.693943_551.1 target=1_1627314932.293442_543.1 2021-07-26T16:00:33.779 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:33.780 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:33.780 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:00:33.822 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:00:33.823 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:00:33.858 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~297s 2021-07-26T16:00:34.013 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314932.293442_543.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:32.293442Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:00:34.014 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314933.693943_551.1 target=1_1627314932.293442_543.1 2021-07-26T16:00:39.015 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:39.016 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:39.016 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:00:39.056 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:00:39.057 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:00:39.265 INFO:teuthology.orchestra.run.smithi197.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"816a1f73-b2bd-4f0e-a507-b6c39ba8a110","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627313858.513002_27.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:37:38.513002Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1627314932.293442_543.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:55:32.293442Z","realm_epoch":4}},{"key":3,"val":{"state":1,"marker":"1_1627314002.183348_103.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:40:02.183348Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:00:39.266 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1627314933.693943_551.1 target=1_1627314932.293442_543.1 2021-07-26T16:00:39.464 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~303s 2021-07-26T16:00:39.465 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2021-07-26T16:00:40.069 INFO:tasks.ceph.c2.osd.0:Sent signal 15 2021-07-26T16:00:40.072 INFO:tasks.ceph.c2.osd.1:Sent signal 15 2021-07-26T16:00:40.073 INFO:tasks.ceph.c2.osd.2:Sent signal 15 2021-07-26T16:00:40.073 INFO:tasks.ceph.c2.mon.a:Sent signal 15 2021-07-26T16:00:40.074 INFO:tasks.rgw.c2.client.1:Sent signal 15 2021-07-26T16:00:40.074 INFO:tasks.ceph.c2.mgr.x:Sent signal 15 2021-07-26T16:00:40.076 INFO:tasks.ceph.c2.osd.0.smithi197.stderr:2021-07-26T16:00:40.069+0000 7fed0814c700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster c2 -i 0 (PID: 14338) UID: 0 2021-07-26T16:00:40.077 INFO:tasks.ceph.c2.osd.0.smithi197.stderr:2021-07-26T16:00:40.069+0000 7fed0814c700 -1 osd.0 65 *** Got signal Terminated *** 2021-07-26T16:00:40.078 INFO:tasks.ceph.c2.osd.0.smithi197.stderr:2021-07-26T16:00:40.069+0000 7fed0814c700 -1 osd.0 65 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-07-26T16:00:40.079 INFO:tasks.ceph.c2.osd.1.smithi197.stderr:2021-07-26T16:00:40.073+0000 7f7ea60fb700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster c2 -i 1 (PID: 14341) UID: 0 2021-07-26T16:00:40.079 INFO:tasks.ceph.c2.osd.1.smithi197.stderr:2021-07-26T16:00:40.073+0000 7f7ea60fb700 -1 osd.1 65 *** Got signal Terminated *** 2021-07-26T16:00:40.080 INFO:tasks.ceph.c2.osd.1.smithi197.stderr:2021-07-26T16:00:40.073+0000 7f7ea60fb700 -1 osd.1 65 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-07-26T16:00:40.080 INFO:tasks.ceph.c2.osd.2.smithi197.stderr:2021-07-26T16:00:40.073+0000 7f9ff2899700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster c2 -i 2 (PID: 14343) UID: 0 2021-07-26T16:00:40.081 INFO:tasks.ceph.c2.osd.2.smithi197.stderr:2021-07-26T16:00:40.073+0000 7f9ff2899700 -1 osd.2 65 *** Got signal Terminated *** 2021-07-26T16:00:40.081 INFO:tasks.ceph.c2.osd.2.smithi197.stderr:2021-07-26T16:00:40.073+0000 7f9ff2899700 -1 osd.2 65 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-07-26T16:00:40.083 INFO:tasks.ceph.c2.mon.a.smithi197.stderr:2021-07-26T16:00:40.073+0000 7f4c7f713700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-mon -f --cluster c2 -i a (PID: 14152) UID: 0 2021-07-26T16:00:40.083 INFO:tasks.ceph.c2.mon.a.smithi197.stderr:2021-07-26T16:00:40.073+0000 7f4c7f713700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2021-07-26T16:00:40.084 INFO:tasks.rgw.c2.client.1.smithi197.stdout:2021-07-26T16:00:40.073+0000 7f44177fe700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=8001 -n client.1 --cluster c2 -k /etc/ceph/c2.client.1.keyring --log-file /var/log/ceph/rgw.c2.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.1.sock --foreground --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm (PID: 29068) UID: 0 2021-07-26T16:00:40.084 INFO:tasks.rgw.c2.client.1.smithi197.stdout:2021-07-26T16:00:40.073+0000 7f442800c980 -1 shutting down 2021-07-26T16:00:40.085 INFO:tasks.ceph.c2.mgr.x.smithi197.stderr:2021-07-26T16:00:40.073+0000 7fd99f4c5700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-mgr -f --cluster c2 -i x (PID: 14155) UID: 0 2021-07-26T16:00:40.085 INFO:tasks.ceph.c2.mgr.x.smithi197.stderr:2021-07-26T16:00:40.073+0000 7fd99f4c5700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2021-07-26T16:00:44.267 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:44.268 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:44.269 DEBUG:teuthology.orchestra.run.smithi197:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:00:44.311 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:00:44.312 INFO:teuthology.orchestra.run.smithi197.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:05:44.314 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T16:05:44.305+0000 7f6b4f095980 0 monclient(hunting): authenticate timed out after 300 2021-07-26T16:10:44.314 INFO:teuthology.orchestra.run.smithi197.stderr:2021-07-26T16:10:44.311+0000 7f6b4f095980 0 monclient(hunting): authenticate timed out after 300 2021-07-26T16:13:30.079 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2021-07-26T16:13:30.082 DEBUG:teuthology.task.console_log:Killing console logger for smithi183 2021-07-26T16:13:30.083 DEBUG:teuthology.task.console_log:Killing console logger for smithi197 2021-07-26T16:13:30.085 DEBUG:teuthology.exit:Finished running handlers